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ABSTRACT 

These studies examine the dissemination strategies of 
ten selected educational innovations that illustrate a number of the 
problems and solutions that have emerged froK past experience. In 
studying the diffusion of these products and programs, facts have 
been sought about what happened between conceptualization and 
implementation. The study tries to ascertain what was done at each 
step in the life ot a product where a decision qould affect its 
success in reaching users. Although thii focus is diffusion, 
examination of product design and testing is also included, since the 
actions taken at these stages could hav>s a crucial impact on eventual 
market success. The products and programs possess a wide range of 
types and degrees of innovational complexity and success. Their 
diffusion histories illustrate the diversity of tactics that have 
been tried. The products discussed have been developed and 
distributed by various combinations of research and development 
agencies, other nonprofit agencies, and commercial firms. Key points 
of general interest have emerged and are summarized to help fill a 
need in the diffusion literature for facts and inferences culled from 
practical experience, and to give advice to developers, 
disseminators, and funding agencies. (Author/MLF) 
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FOREWORD 



If you wanted to bring about a change 1n education that would be of 
benefit to children all over the country, how would you do It? You might 
develop a product--a curriculum, a teacher-training system, a teaching 
tool--and test that product until you could be reasonably sure that 
anyone who used it would be able to bring about the outcomes you originally 
Intended. But what would happen then? Would anyone buy the product, and 
once it was bought, would anyone use It? 

Within the past decade, the people who have developed and disseminated 
Innovative educational products have learned a great deal about the problem 
of promoting change In schools. They have learned that naive expectations 
will not be fulfilled; the proverbial "better mousetrap" does not sell 
itself. Instead of just developing and polishing a product and then hoping 
for the best, they are beginning to think of diffusion, or the process by 
which an innovation reaches users, as a problejn that deserves careful con- 
sideration at all stages of the development and dissemination process. 
This lesson has been learned slowly and painfully through meeting unexpected 
barriers when the easy solut1ons--publ1cat1on of a few journal articles, 
setting up a booth at a conference, leaving it all up to a publishing com- 
pany--have proved ineffective. It is only recently that creativity and 
careful planning have begun to pay off in the widespread adoption and use 
of some of the products of educational research and development. 

This book contains ten case studies that illustrate a numf)er of the 
problems and solutions that have emerged from pa^t experience. In studying 
the diffusion of the ten products and programs, we have sought the facts 
about what happened between conceptualization and implementation. We have 
tried to ascertain what was done at each step in the life of a product 
where a decision could affect its success in reaching users. Our focus 1s 
diffusion, but in addition to the activities usually called by that name 
we have also examined product design and testing, since the actions taken 
at these stages can have a crucial Impact on eventual market success. 

In choosing programs or products we tried to cut across a number of 
dimensions that seemed to represent Important clues to diffusion success or 
failure. We did not draw our subjects from a random sample of all available 
programs. The products and programs themselves possess a wide range of types 
and degrees of innovational complexity; they include a few that can just 
barely be called products and one that was a school for teacher education. 
Some have been notably, even astonishingly, successful (some despite a slow 
start), while others must be termed failures. Their diffusion histories 
illustrate the diversity of tactics that have been tried. 

The products discussed have been developed and distributed by various 
combinations of research and development agencies, other nonprofit agencies, 
and commercial firms* The subjects of the first two studies are R&D pro- 
ducts with minimal involvement of con^nercial firms; they are followed by 
four R&D products that were comerciaDy distributed, two products that 



INTRODUCTION AND SUMMARY OF FINDINGS 



Seeking solutions to the educational problems plaguing American 
schools during the 1960s and early 1970s, research and development agencies 
came up with a myriad of Innovations. The developers assumed that educa- 
tors would welcome the products and that change would permeate the land. 
But by now, although the techniques for iT»easuring the pervasiveness of the 
resulting change are not very reliable, it does seern quite clear that 
schools have not adopted the innovations in overwhelming numbers. The cas€j 
studies in this book examine the dissemination strategies of selected educa- 
tional innovations in an attempt to unravel som of the reasons vrhy the use 
of the products has generally proceeded at a siiaiTs pace. While developers 
are quick to point a finger of blame at disseminators, and disseminators turn 
it right around, we have concluded that blame for an Innovation's apparent 
failure or credit for its apparent success must be spread evenly through 
development, dissemination, and support for implementation. In this intro- 
ductory section, we identify some key points 1n each stage of a product's 
life where people's choices seem to inhibit or facilitate the product's 
eventual use. 



DEVELOPMENT 

To a large degree the success or failure of a product rests in the hands 
of its creators. Developers have tried to meet people's needs, to follow 
a rigorous research and development cycle, and to conduct informative field 
tests. Why, then, have some products not been more successful? It seems 
obvious, particularly in the light of the cases we have studied, that one 
of the main factors in the success of an innovation is its form. 

Inno vations seem to have the greatest p rosp ect for succes s when they 
involve a t angible "producT^coupled with provision for lrgTninc|. 

Many developers made a critical decision about form when they determined 
that they would develop self-sufficient packages that would not require 
special training for users. The simulation games, for example, come in boxes 
complete with materials and detaiVid instructions. It was assumed that they 
could be bought and used with little or no training, since it seemed a 
straightfo^ard matter for teachers to purchase and use them without prior 
"hands-on'* experience. But in fact the developers of simulation games found 
that the most enthusiastic users were teachers who were introduced to the 
games through active participation in workshops. 

Other developers, who have gone to the other extreme and produced train- 
ing programs without materials, have also had their share of problems. When 
Technology for Children consisted of sumyier workshops for teachers but did 
not involve any materials, the concepts of the program did not seem to 
persevere in classrooms, however, when teacher training is extensive, success 
ful innovation may not depend on the existence of a product. The New School 
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encouraged the spread of open education throughout North Dakota by offering 
one- or two-year training to teachers. 

Not an developers have adjusted to two facts about potential users: 
they may prefer riot to charig6 their behavior, and they may wish to make 
adaptations In a product . ^ 

Products that are fun for developers or Intriguing for funding agencies 
may be difficult to absorb Into school settings. Developers and funding 
agencies alike have been bitten by "media bugs" or "simulation bugs" or 
similar infatuations. This seems only natural since the mass media and pro- 
fessional opinion give currency to innovations decked out in unique packaging. 
Practically speaking, however, most schools have neither the equipment nor 
the inclination to adopt materials that are far removed from current practice. 

Developers of the Minicourse, while they did not engage in wild flights 
of tedi;..>ioqic?l fancy, chose to deviate from the traditional approach 'to 
inservice teacher education. They pointed out that there was no evidence to 
indicate that hiring a consultant to give advice and advocate change resulted 
in changed behavior. Instead, they elected to produce a self-instructional 
kit with a highly structured program of practice and self-evaluation, focusing 
on a few precisely defined skills, and using sophisticated electronic hard- 
ware. This decision, based on present evidence, had ramifications for the 
diffusion of the product. Despite evidence of Hinicourse effectiveness, the 
people who make decisions in schools seemed to prefer to spend their money 
on the more familiar "product" of the consultant. They knew how to schedule 
a meeting of all their teachers in an auditorium; they had to be convinced 
that it was worth their while to set up a VTR and schedule microteaching 
sessions. It seems that the unfaiViiliar format of the Minicourse impeded its 
implementation. 

Whatever basic design is chosen for a product, a considerable amount of 
flexibility in this design seems to help in di.fusion. The Drug Decision 
Program, a rather lengthy curriculum. Is so tightly sequenced that schools 
are unable to trim it to fit their schedules. On the other hand, since a 
publisher began treating Man: A Course of Study as an unfinished or 
"unpackaged" curriculum with Infinite possibilities for adaptation. Us 
implementation has increased greatly. 

The m eaningful involvement of potential users is an important factor 
In a successful product desig n. 

Most of the developers studied made some attempt to enlist the help of 
potential users In the planning and testing of products. Although the 
stimulus or concept typically came from within the development agency, most 
developers made a substantial effort to check the idea or a prototype of a 



ERIC 



4 



product with samples of potential users. When they didn't, the results 
were nearly disastrous. Lockheed, a company with little prior experience 
In education, assembled the first version of the Drug Decision Program with- 
out help from users; upon Us release the product was a failure, and the 
company revised Its development approach to Include user Input. Another 
commercial developer Inserted laboratory equipment into the Inquiry Develop- 
ment Program In Physical Science (lOP) without consulting users, and the 
equipment has not sold well. Some developers have gone much farther than 
others In the Involvement of users and have been encouraged by the results. 
Teachers who use Man: A Course of Study are given training in curriculum 
development; to some extent they become colleagues of the developers. The 
Technology for Children project has developed almost entirely from sugges- 
tions and input from participants. 

Many developers are falsely led into believing that their products 
will "sell" because of the favorable opinion of field-test subjects AFTER 
having used the product . 

Remember that a potential user usually must decide whether or not to 
adopt a project without having had extensive experience with it. Many 
field-test users were asked whether they liked and would continue to use 
a product on the basis of a rather complete experience with the product. 
This seems to be a serious error in the development process, because it 
led several developers to assume that their products would be accepted 
when in fact they went over well only after the users had tried 'them. 
Distorting two popular cliches, we might say that you can lead a horse to 
water, but you can't make him drink; only after he's tried it is it pos- 
sible to determine if he liked it. ' 

Little concerted effort has been made to study the effectiveness of 
the format in which the new product will be presented to the user. Yet it 
Is on the basis of this format (not his experience after he has adopted it) 
that he will decide to use it or not. The typical questionnaires accom- 
panying R&D field tests ask the field-test subject to indicate how he liked 
the product, whether he would recommend it to friends, and whether he would 
spend a given dollar amount for it. These questions serve only as a measure 
of consumer satisfaction that may indicate re-use potential and what first 
users might say to others about a product. 

Developers can gain valuable information if they seek the reactions of 
buyers and facilitators, as well as u sers, when field testing their pro- 
ducts . 

r .u^^u? Minicourse as an example. Teachers are the primary users 
of the Minicourse. As a result, the field testing focused heavily on 
whether or not teachers liked, used, and learned from the Minicourse, and 
the data suggest that the developers were successful in meeting the needs 
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of teachers. But teachers do not buy Mini courses. F^ecause of the expenf,e 
Involved and the need for special equipment, scheduling, and released 
time* administrators usually must take the initiative to secure the course 
and install it. Minicourse field tests did not reach these administra- 
tors. Their reactions were not sought in a structured fashion, and de- 
velopment activities were not undertaken to design the training packages 
to meet their perceived needs. Similarly the "facilitators" for Mini- 
ccurses were not studied as carefully as they might have been. From the 
point of view of the person who must locate a microteaching room, handle 
scheduling, and find the equipment, the Minicourse often creates problems 
rather than solving them. The development process did not take these 
obstacles into full consideration. 

When buyers or facilitators were involved in the testing and appro- 
priate adaptations made to their needs, the effort appeared worthwhile. 
For example, the niultiunit school, with all the changes and potential 
threats it creates for the people who must decide to adopt it, was tested 
with "buyer" and facilitator needs in mind* 

Some developers select field-test subjects who are already predisposed 
to use the products > 

Field-test subjects have never, to our knowledge, been chosen by 
systematic sampliny procedures to represent the product's target n:arket. 
Developers often choose to work vHth schools they have been involved with 
in the past, as in the case of the muUiimit school's development. The 
test users of many products have been people who had a special interest 
in the product and volunteered to try it. As a result of such methods 
of selection, samples of users are biased, and when the products are re- 
leased to the total target audience they meet resistances that have not 
been studied. The simulation games are a good case in point. All of the 
field-test users were interested volunteers. In retrospect the developers 
found that the average teacher was much less enthusiastic than those 
who selected themselves for participation in field tests. 

D qvelopers tend to assume that their products are operationa l ly self- 
suffici ent, and field tests are not al ways set up so^as to revearToper a-" 
tionaT problen^s . 

InUome of the cases studied, the final product contained deficiencies, 
usually revolving around the procedures for putting it into operation. 
Instructions were unclear or unrealistic, operational guides or installa- 
tion guides were missing or incomplete. Salesmen reported that users 
coudl frequently identify some simple difficulty that was overlooked. 
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One reason for this deficiency may be that the developers tend to 
hover over test subjects more closely than they should. It is natural that 
when the product's attainment of its objectives is being studied, opera- 
tional details should be miniwized. For example, asking the test user 
to submit data in a specified format may cause him to behave in atypical 
ways that conceal operational deficiencies. But at some point, the devel- 
oper must discover how his product will fare when he 's not around. Some 
agencies have created elaborate procedures for conducting "hands-off" 
tests; others have not. An operational form of Mini courses was developed 
and tested to determine whether teachers could use the course in a prac- 
tical setting without assistance from the developer. Since users found 
the Handbook difficult to use because of its unnecessarily technical 
language, it was revised. 

Development Recommendations 



Developers can take several steps to avoid the pitfalls we have iden- 
tified and to help insure the implementation of innovations in schools. 
First, it seems apparent that developers and funding agencies should he 
careful to avoid commitment to a particular product form too early in the 
game. Alternative forms that might be used should be studied carefully 
in the light of resources and attitudes prevalent among users. Funding 
agencies* requests for proposals should not require the prospective develop- 
er to commit himself prematurely to any special media format, and some 
flexibility in committed dollar anounts should be tolerated so as to permit 
the most sensible format decision. 

Second, field testing should be planned so as to yield a maximum 
of valuable marketing information. Test* data should be gathered on 
the appeal of the product's form to potential users. At an early 
phase in the development cycle, it is important that the developer study 
the patterns by which a product will be bought, implemented, and used, 
and tests should insure that all key figures in this cycle find the product 
acceptable. Field-test subjects should be carefully chosen to represent 
the target population for whom the product is ultimately intended. Tests 
of the package's operational completeness should be structured so as to 
avoid too much control or involvement on the part of the developer. (The 
use of unobtrusive data collection mechanisms could contribute greatly to 
solving this problem.) 

During the design and testing of a product, then, developers should 
be considering the way the market will react to it. They should try to 
secure the participation of potential users, and they should continually 
ask several questions about the emerging product: Will it clearly meet a 
.leed that is salient to users and also to buyers? Will its form be accept- 
able to these people? Has it been tested with an unbiased audience and 
in a setting that is realistic enough to reveal its operational weaknesses? 
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DIFFUSION 



Many different strategies have been tried in the effort to bring 
about the adoption and use of innovative products. Development agencies 
have marketed their own products, sometimes with federal support for such 
tactics as the establishment of demonstration sites. Products have been 
turned over to large, prestigious publishers and to their teams of ex- 
perienced salesmen. Networks of linking agents have been trained to pro- 
vide implementation assistance. 

With all of these efforts, why hasn't the use of educational inno- 
vations become more widespread? Several stumbling blocks are apparent. 

The fact t hat a product has come from a research and dev elopment 
effort does not automatically increase user demand" ' 

At one time. It may have been thought that products coming out of a 
rigorous research and development cycle would be readily adopted, thanks 
to the weight of evidence that they work. However, as we talked with 
salesmen or the dissemination staffs of developmental agencies. It became 
clear that they had experienced few instances in which the research or 
evaluation that took place in the development of a product was a critical 
factor in its adoption. Evaluation reports and data analyses were of 
little specific help in the marketing of a product. The demand for a 
product seems to be more a function of the appeal of the concept or the 
perceived utility of the product than of how it was developed or even what 
effect it has. For example, the Toy Library seems to have been used 
because the idea of parents working with their children at home made sense, 
rather than because there was evidence that it produced beneficial out- 
comes . 



On the other hand, the institutional prestige of a developer or dis- 
seminator may impress purchasers. Those involved in Minicourse dissemina- 
tion say that the Far West Laboratory's reputation has added to the product's 
appeal. Han: A Course of Study is disseminated with the help of a cross- 
disciplinary body of consultants know as The International Faculty, whose 
professional credentials and experiences seem to enhance the appeal of the 
curriculum 

D1stance--either psychological or physical --between developers and 
disseminators has frequently hampered the diffusion of a produc£ . " 

Generally, we found that developers completed a product and then 
turned It over to another group of people for dissemination. Occasionally 
the disseminators were members of the same agency. In some Instances, even 
when personnel from the development division had been transferred to aid 
in the dissemination of the product, feelings of competition arose between 
the de^'elopers and disseminators; developers believed that they had a 
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better understanding of the product and would ba better able to handle 
disseiiiinatioh* Although we cannot prove that the lack of cooperation 
resulted In losses In sales, It Is unlikely to have helped. 



Problems In distribution also seemed to Increase in proportion to the 
physical distance between the developer and those who brought the product 
to users. In the case of RUPS, a small local printing company handles 
most of the actual distribution of the product i communication between the 
Laboratory and the printer is good. But those primarily responsible for 
disseminating the product, a network of 18 trainers, are isolated from 
the developers and from each other. Dissatisfaction seems even greater 
when the publisher is geographically separated from the developing agency. 

The result of these differences has been the loss of potentially 
valuable cooperation. Developers have seldom been able to appreciate 
and take advantage of the expertise of a commercial sales force. Publishers 
contend that salesmen have a valuable understanding of conditions in 
schools, and that if they believe in a product and are willing to expend 
their time on it, they can convince their customers of its merits, Con- 
versely, the publishers have seldom solicited or listened to advice from 
the developers. »This seemf. unfortunate since the developer frequently 
has a great deal of experience in relating the product to users. 

The importance of incentives offered to the salesmen. Intermediate 
agents, or others responsible for dissemination, distribution, training, 
and installation has frequently been overlooW . 

For the commercial salesman, there must be enough commission from the 
sale of a product to warrant his carrying it in his sample case. He likes 
to handle fairly traditional products, preferably items with built-in 
"multipliers." (When a product with multipliers is sold to a superintendent, 
principal, or teacher, the number of actual sales is "multiplied" by the 
number of students who will need copies of the product.) The ideal sales 
item, from a conwercial viewpoint, is a workbook which must be replaced 
annually. 

By contrast, most of the products of the past half decade of R&D 
represent a break with tradition. School people may need to make some 
effort to become familiar with these 1nnovat1ons--and salesmen cannot af- 
ford the time to help in this process. Furthermore, many of the products 
are one-of-a-kind items which do not Involve a need for multiple copies. 
Often the dollar cost of a single Item Is too low to yield a substantial 
commission to salesmen. 

The lack of financial Incentives also extends to the loose networks 
of trainers that several agencies established. It was hoped that these 
trainers would find it in their interest to promote a product on the 
basis of the income they might earn by training adopters to use the pro- 



duct. This did not happen In the case of RUPS or the Toy Library, apparently 
because the effort required was too great and the return too low. If 
these desions are to work in the future, better plans for supporting the 
trainers will be required. 

The problem of incentives extended even to state departments of 
education. In one case, when a state department's help was Solicited to 
promote a product, the developer was told that the state department staff 
would help only if they were paid (as they had been by another developer, 
who had hired the state department to establish demonstration sites). In 
addition, states could seldom be Induced to help in any extensive way if 
the State priorities (usually set a year or two in advance) did not happen 
to encompass the problem the product would presumably solve, 

When there was a match between the priorities of a linking agency 
and a product, a highly successful linkage occurred. For example, one 
regional service agency in Colorado took the Minicourses and promoted 
their use in its area without significant help from the developers. 
Performance^based teacher education was a top priority in their focus, 
and the Minicourses represented an almost perfect fit. 

The concept of market segmentation has had only the most rudimentary 
use in education, but it seems to hold promise. 

Market segmentation is based on the fact that different users have 
different wants and needs. The total market can be divided into segments 
that are more or less likely to adopt a particular product; marketing 
resources can thon be concentrated where they will do the most. Tho 
Technology for Children staff made informal assessments of different 
schools' level of Interest in the program, and they devoted their efforts 
to the most probable adopters. 

Market segmentation makes obvious economic sense because it allows 
limited funds to be taraeted rather than spread out in a futile effort 
to capture every potential buyer. Contacting all 16,000 school districts 
in the United States is considerably more expensive than contacting the 
4,000 largest ones, but the 4,000 districts enroll about 80 percent of 
the nation's students. On the other hand, the very largest of these dis- 
tricts have complex structures and require very special handling by mar- 
keters if they are to become extensive users of a new product. 

Within the district or the school, the idea of segmentation dictates 
that the diffusion effort be targeted to key decision makers. In the 
first phase of diffusion for Man: A Course of Study, the developers held 
workshops to train teachers both in teaching skills and in dissemination- 
yet few of the participants were able to bring about adoption of the 
curriculum. But when similar workshops were held for staff development 
personnel, many more adoptions resulted, and the publisher now devotes 
much of its energies to these people. 
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simple awareness-orlentfed advertising efforts are generaltv not suf^ 
ficlent to lead potential users to purchase a p roducts : : - 



For nearly all of the products studied* vast mailings and magazine, 
newspaper, and televlson publicity campaigns have been conducted. In 
retrospect disseminators believe the efforts were unsuccessful In accele- 
rating sales unless there was strong, directed follow-up on each lead 
generated from a general diffusion effort. Advertising may be sufficient 
for a textbook but not for a complex educational Innovation. 

Th6 awareness phase Is necessary, of course j no one can adopt some- 
thing he has not heard of. But dissemination staffs have not always 
used cost-effective ways of presenting basic information to a target 
audience including buyers as well as users. For example, the traditional 
approach of setting up a booth at a convention has not proven to be ef- 
fective, since travel and per d1em must be paid for one or two staff 
members, and records show that few people take particular notice of a 
display booth. 

It is believed that dissemination efforts Involving trial experiences 
are the most effective. Apparently the Involvement must be an active, 
real one, not a passive "snow-and-tell" demonstration.' ! 

Dissemination personnel have learned that potential users need to be 
given a real understanding of a product, preferably through trial experi- 
ence with it. When they presented an orientation on the Toy Library, dis- 
semination staff always tried to Include workshops for small groups of 
people to play with the toys and find out how to use them in learnina 
episodes.. The many teachers and students who participated in field tests 
of the simulation games wanted to purchase games and pressured the de- 
velopers to release them as soon as possible. The multlunit school is 
"disseminated" by having potential users attend the first part of an in- 
stallation training program. On the other hand, elaborate arrangements 
to have users travel to demonstration sites have not worked when there 
was no meaningful involveinent between the user and the product. It seems 
that the enthusiasm of test users after their experience with a product, 
which we have mentioned as a problem in testing strategy* can be an ad- 
vantage when it is used as a part of dissemination strategy. Salesmen 
have long known that It Is effective to provide potential customers 
with sample materials, but not all educational developers have devised 
ways of doing this with their complex products. 

Demonstration projects are not the easy panacea that some have 
thought them to be". 

To fill educators' apparent need to see new products in action, a 
number of projects with substantial federal funding set up innovative 
products In operational settings. The idea was that people could observe 
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the product, d i ss It with colleagues, and decide whether to adopt It. 
The eva uatlo. of these projects showod that most visitors commented 
favorably, but we found only one project that established a connectiori 
between demonstration and sales: Minlcourse sales did cluster around 
the sites. In the case of the Toy Library, visitors said that their 
informational objectives had been met, but few adoptions could be traced 
directly to their visits. 

Why are the results of this tactic uneven? It appears that in addi* 
tion to the Interaction between the product and the prospective user, the 
effectiveness of a demonstration site depends upon the local people run- 
ning it; they must be willing and able to attract the interest of nearby 
school personnel. Some demonstration sites have been operated as service 
projects, where the purpose is to put the product to work in the local 
setting and not to help visitors understand and evaluate it. Thus it Is 
important to give site personnel training, suggestions, and support for 
their role as active disseminators. 

Insufficient attention has been given to the cost eff ectiveness of 
dissemination efforts. " — ~ " 

Commercial salesmen who have worked with R&O products acknowledge 
that considerable expense is necessary to bring about the adoption of 
complex, innovative products. A staff member at one publishing company, 
who believes strongly in the value of the product it markets, is pleased 
that the company has not Jone a cost effectiveness analysis of these 
efforts; it it did, it m ght drop the product. 

Development agencies have given little attention to cost effective- 
ness. In many cases studied here, dissemination costs were not even 
recorded, let alone broken down into components. Criteria to measure 
effectiveness are also missing. Follow-up questionnaires have been 
used to assess people's reactions to information campaigns, but it is 
difficult to know what constitutes success. Should a conference presen- 
tation result in one hundred people's awareness of the product? Fifty 
people's understanding? Ten adoptions? In short, objectives have seldom 
been set and the distribution of resources has almost never been studied. 

Oiffusion is expensive. 

When a product represents a significant departure from the traditional 
practice in schools, the conventional tools of low-budget educational mar- 
keting are unlikely to lead to its widespread use. Awareness campaigns- 
magazine advertising, direct mail, "show-and-tell" presentations at con- 
ferences—are not very costly, but at the same time they are not sufficient 
to lead to adoption and use. When a product demands attltudlnal and 
behavioral changes on the part of users, it will not find a ready market. 
Somehow the market must be made ready, but this is not a profitable 
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endeavor for convnercl a 1 companies. Despite a belief In the value of IDP 
as a science curriculum* SRA had to decide to drop It because of the pro- 
hibitive cost of promoting Its use. The multlunit school has been relatively 
successful, apparently because a large-scale* long-term comtnltment was made 
by the developers and the government to support a complete dissemination/ 
Implementation effort. 

01 f f usi on Reoommendatlons 

Many of the problems In dissemination are similar for all the products 
covered in theso reports. If educational Innovations are to be Implemented 
In schools* It seems Imperative that the disseminators take Into account 
these difficulties; The following suggestions are offered to those who 
will be involved in future diffusion efforts. 

Although the fact that a product has come from a research and develop- 
ment effort does not create user demand* in the long run it seems impor- 
tant to us that the educational community value the work of R&D. Though 
we may need to work with users "as they are," sponsors of R&D work have an 
obligation to increase awareness and positive attitudes about R&D. To 
achlevo thi s end vli 11 probably requi re an effort to promote the R&D qual 1 - 
ties of specific products as well as a more generalized public information 
program..; /. './^ • ; 

cooperation and coordination between developers, disseminators, and 
trainers must be improved. Efforts where the disseminators had a good 
understanding of the goals of the innovation and its complexities were 
the most successful. Therefore, It is important that close linkages be-: 
tween the developers and the disseminators be consciously created and 
nurtured. If innovative products with low multiplier characteristics 
continue to be developed, the current policy of encouraging distribution 
through commercial firms employing salesmen should be carefully reviewed* 
and alternative strategies should be considered. 

In addition, the design of a product should carefully consider how 
the key "linkers" will be involved and what incentives can be tapped to 
activate and maintain their relationship. This analysis should not assume 
altruistic behavior on the part of all educational professionals but 
rather should look at questions of economic incentives as well as program- 
matic incentives that derive from locally-set priorities. This point is 
of particular concern in dealing with state departments, which seldom have 
more than a few operational priorities in a given year. Since these 
priorities are usually set several years in advance, any plan that pro- 
poses to Involve state departments (or other public agencies) should care- 
fully assess the "fit" between the proposed product and the probable 
priorities of the agencies at the time the product is completed. 



13 




It Is aefierally believed that simple awareness efforts are not suf- 
ficient to lead potential users to purchase a product} this 11 not meant 
to suggest that these efforts should be discontinued. Controlled studies 
of .these efforts and their effects should be conducted to deterwl/ie the 
actual influence on potential users. It now appears that resources are 
more effectively allocated to dissemination activities which involve 
the potential user in a trial experience with the product. Large-scale 
demonstration efforts should only be undertaken with extensive training 
and support for site personnel . Any effort to disseminate information 
or awareness must be closely coupled with personalized follow-up or much 
of the effort will be In va1n. 

Before any detailed analysis of dissemination efforts can be conduc- 
ted, agencies will have to keep more precise records of their expenses and 
their results. Even then, it will be difficult to ascertain quickly the 
success or failure of an Innovation, since the cycle of change In schools 
is relatively slow. 

IMPLEMENTATION AND TRAINING SUPPORT 

Many developers and disseminators have assumed that their products 
were operationally self sufficient and that implementation would pose no 
problem. Gradually they have come to realize that school personnel need 
training, assistance, and encouragement. Our studv of educational inno- 
vations has highlighted several ways that developers and disseminators 
can help users successfully implement innovative products. 

Helping potential adopters locate money for a product has had good 
results . 

A statement heard frequently from non-adopters is, "We can't afford 
it." Some agencies have addressed this problem directly, either by sub- 
sidizing adoption or by helping purchasers to find outside funding. As 
an incentive to users, the Technology for Children Project supplies $600 
per teacher, to be used for whatever materials or support seems to be 
needed in the first year a school has the program. (After the first year, 
funding is the users' responsibility.) The publishers of both the Drug 
Decision Program and Man: A Course of Study have worked with schools 
seeking outside funds to support these programs. There Is no question 
that financial support has helped many Innovations. 

Many, if not most, of the products of R&D demand training for users, 
but this is not always recognized early enough . ' — *■ 

It is fairly obvious that a new curricular approach requires some 
teacher training, but it has been less obvious that a teaching tool, 
like a simulation game, or a packaged program for teacher education. 
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like a Hinlcourse, will be used more effectively it users are given per- 
sonal guidance beforehand. In both these cases, methods evolved for 
providing training! the developers of the games and one of the sales- 
men held workshops for teachers to play the' games and become familiar 
with them; Mini course purchasers sometimes had implementation help from 
the developing agency, the publisher, or an intermediate agency. How- 
ever, it is admitted that these ad hoc efforts were inadequate and that 
assistance for users should ha ve*Tee*nbui It Into the dissemination plans. 

The Toy Library program revolves around training for parents, yet 
because the materials and the training are obtained separately from 
different sources, people often acquire tne materials alone. Partial 
implementation is the result--al though the developer never intended the 
toys to be used without the training, This problem ill ustrates the need 
for a structure to guarantee the inclusion of needed training; it cannot 
be assumed that users will seek out a training program on their own. 

The multiunit school, on the other hand, does not involve a package 
of materials (except for /I/D/E/A/'s support materials); adopting this 
change means embarking on a program of training for the entire school 
staff. Because training is so critical, the two agencies involved with 
this innovation carefully set up systematic programs that include work- 
shops, clinical training, and inservice institutes for graduate credit. 
The Wisconsin R&D Center has stressed professional development for school 
staff, who can earn graduate credit at participating universities as they 
acquire their training. The incen'iive of increasing one's professional 
competency has also been used to good effect in the diffusion of Han: A 
Course of Study. Training is required for teachers who implement this 
program, to prepare them r'>t only for its particular content and tech- 
niques but also to engage in their own curriculum development to comple- 
ment it. 

Training systems can be a useful way to involve a variety of linking 
agents in diffusion . 

Some agencies established networks of agents to provide training. 
The most striking example of this tactic has occurred with RUPS, a train- 
ing package that is so tightly structured, its developers claim that most 
trainees can conduct training themselves. Therefore its dissemination 
depends heavily on a multiplier effect whereby every user becomes a change 
agent. Besides this avenue of diffusion, RUPS has a more formal network 
of regional training representatives, but as we point out above, in this 
case and the case of the Toy Library, the incentives for these people to 
conduct training have not been very great. When inservice training was 
obviously the key to. successful implementation, agencies usually set up 
a system to deliver this training, and the system also served an important 
diffusion function. 



15 



Problems aH$e In the process of ^^1^ an Innovation, and 

user$ need a source of help with these problems. 

Various arrangements have been set up so that adopters can be helped 
In solving the problems that a new product may bring with It. After the 
' end of the MInlcourse demonstration project » at least one site coordinator •.; 
continued to serve as a consultant for nearby schools where the product 
was In use. North Dakota's New School had field agents who visited the 
Interns teaching In classrooms around the state to bring encouragement 
and new Ideas. The multlunit school diffusion plans have designated 
linking agencies to work with Implementing schools; as well as providing 
training, a linker maintains a flow of communication with a group of 
schools. Under the /I/D/E/A/ plan, there Is a great deal of cooperative 
problem solving between schools, through such activities as week-long 
exchanges of staff members. The advantages of sharing the implementation 
experience may account for a pattern noticed among users of RUPS: when 
several teachers from the same school have gone through the program together, 
they are more likely to make use of RUPS in their day-to-day work. 

Once the novelty of innovation has worn off, many products have no 
built-in incentives for continued useT "^ 

In the long run, the benefits derived from a product should insure its 
use, but after adoption and before benefits can be seen, users' interest 
may lag. Of course developers cannot work miracles-, no one can design a 
product that will jump off the closet shelf into the arms of teachers and 
students. However, the plan for implementation support should include ways 
of motivating adopters to continue using the product. Some disseminators 
have set up mechanisms to establish and nurture users' commitment to making 
the product work, so that implementation can be sustained. In the case of 
the multlunit school, adopters are asked to give written assurances of 
their willingness to implement the innovation. The distributors of Man: A 
Course of Study give teachers a grounding in the principles of curriculum 
development so that they can adapt the course extensively, and staff members 
are pleased with the enthusiasm that this plan elicits from teachers. 

I n some cases, the quality of Implementation was monitored; in oth^r 
cases, it was not. Vjhen it was monitored and fed back to the development 
p rocess, the outcome was rewarding . 

Many products pass from the developer through the disseminator to 
the user with no method of insuring correct use. The toys that are part 
of the Toy Library, for example, can be purchased without any information 
or guidelines, and while parents may be using them in situations adverse 
to learning, the developers have no way of knowing this. Some products are 
assumed to'be so self-explanatory that no monitoring Is necessary: the 
developers of RUPS point with pride to the fact that trainees can become 
trainers, thereby diffusing the product without any assistance from the 
Laboratory. 
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However*, since nd one would call a multiunlt school self-explanatory, 
there are procedures for monitoring Us Implementation. The long-term 
commitment of the developers to work with users over a period of several 
years, to keep reinforcing the desired outcomes, and to make modifications 
necessary to Insure use is probably one of the major reasons that the multi- 
unit school has been adopted as widely as It has* For most products, which 
occupy a middle ground between these extremes of simplicity and complexity, 
follow-up may or may not be provided, but It Is almost always needed. 

Implementation Support Recommendations 

' Developers may continue to create Impressive products, but unless they 
are usod, the effort is futile. It Is apparent that unless steps are taken 
to Insure successful Implementation of innovations, schools and educational 
practices will change only slowly. Developers and disseminators of successful 
products have come to realize that nuch time and energy must be spent in 
providing extra help and support to those who seek to Implement a complex 
innovation. AS a first step, they often help potential adopters locate 
sources of funding for new programs and products. For most innovations, 
staff training must be set up to guarantee that users will receive It. < 
These training arrangements may have a beneficial Impact on diffusion, particu 
larly when they provide the adopter with incentives such as increased pro- 
fessional prestige. 

Those who have aided in the successful implementation of products have 
developed mechanisms to help users in solving the problems that inevitably 
arise. While monitoring use of the product, they also motivate educators 
to continue to use the product. Cirganlzed Implementation assistance has 
been the key factor in the success of many innovations and the spark leading 
to impressive changes in educational practices. 
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PRODUCT SUMMARY 



Px^duot name: Multlunit School/lndl vidua! ly Guided Education (I6E) 

Developt^^: Wisconsin Research & Development Center for Cognitive Learn- 
ing, Nadlson, Wisconsin. Additional development by /I/O/E/A/ {Insti- 
tute for Oevelopmi»nt of Educational Activities. Inc.), an affiliate 
of the Kettering Foundation, Dayton, Ohio. 

Dietvibutopt Adoption and implementation through about 100 regional 
linking agencies. 

DesoHpHon: MuUlunlt school (Wisconsin R&D Center's model) - An orcani- 
zational system that replaces traditional , self-contalned classrooms 
wUn larger, nongraded units, In each unit, a unit leader, two or 
three staff teachers, a first-year teacher, a teacher aide, an instruc- 
tional secretary, and an intern work with 100 to 150 students in a 
three- or four-year age span> Unit leaders and the building princi- 
pal make up the Instructional Improvement Committee and cooperatively 
define the school's educational goals. At the district level, the 
Systemwide Policy Comnittee (central office administrators and con- 
sultants, principals, repVesentative unit leaders and teachers) develops 
policy guidelines and coordinates the use of human and physical re- 
sources. 

IGE (/I/D/E/A/'s model) - Organizational change does not have to be 
made at once, Eventiially, thsre are large units 6f students (Learn- 
ing Communities) and a Program Improvement Council of building staff 
(like Wisconsin's Instructional Improvement Committee). Participating 
schools work together in Leagues of eight to 15 schools; to share 
problem solving and new development. 

Objectives for both models center around cooperation among staff mem- 
bers and individualized learning for students. 

Cost: ./I/O/E/A/ inservice materials - $250 to $450 per school. 
A fee may also be required for membership in a League of adopting 
schools, 

Wisconsin R&D Center says start-up cost be $8 to $22 per pupil, 
for additional staff and materials, but some schools have no extra 
start-up cost. — 

Continuing expenses need not be any higher than in traditional schools. 
In a few cases, they are lower. 

Target market: Elementary schools and, recently. Secondary schools also, 
{/I/D/E/A/ has now developed materials for junior high schools, or 
middle schools, and high schools.) No special demographic characteris- 
tics favor adoption, but staff must be In philosophical agreement with 
I6E objectives and practices. 
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Svatuationi Wisconsirt— Three-step iterative sequence of development and 
evaluation, Including expert review* consumer opinion, and empirical 
data on success in meeting criteria. Observation, structured inter- 
views, and ouestionnaiires were used to measure attainment of organiza- 
tional and instructional specifications and admirtistrative objectives. 
Overall results reported in 1971 indicated that i&R units functioned 
"reasonably effectively,'^ as did "the majority of ICCs," and that the 
effectiveness of SPCs was still in doubt. 

Oregon's Center for the Advanced Study of Educational Admlnistratioh 
conducted a longitudinal study of task structure and specialization, 
working relationships, decision making, and job satisfaction. Results, 
in terms of experimental vs. control groups, showed progress i:oward 
objectives. 

Student learning has been evaluated only in connection with the R&D 
Center's IGE curricular materials. 

One researcher has studied children's attitudes in a sample of 25 
schools--13 multiunit and 12 control. Multiunit pupils had more posi- 
tive attitudes toward themselves as learners, other pupils, instruc- 
tion, school in general, the school plant, and the coimiunlty; no atti- 
tude difference toward teachers and administrators j and no difference 
in attendance or tardiness, 

/I/D/E/A--Procedures now under development will assess the degree of 
implementation of IGE. Inter-rater reliability and validity now seem 
satisfactory. 

An opinion polling agency has begun longitudinal study of attitudes 
of students, teachers, parents, and administrators. A university has 
studied school climate by the case study method. 

Current etatus: Can be implemented by working with one of the linking 
agencies. The idea is also being extended to secondary schools, and 
staff training is being Incorporated Into preservice teacher education. 

Innovative effeote: IGE alters the traditional organization of schools. 
Instead of one autonomous teacher in each classroom, there are teams 
of staff members working with large, nonaraded groups of pupils; 
decision making becomes cooperative, with a system of staff committees 
at different administrative levels. Instructional processes change 
in the direction of individualized, diagnostic-prescriptive methbds. 
In adoptincj IGE, a school commits itself to a thoroughgoing program 
of inservice training in which the staff learns to work in the new 
task structure. 
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sytiopHe of diffusion i The key to both agencies' diffusion strategies 
has been heavy Implementation assistance, an approach which they 
credit with' producing the Innovation's apparent success. Regional 
linking agencies coordinate the extensive Inservice training that a 
school undertakes in adopting I6E, These agencies also supply needed 
help with any implementation problems, and this outside support seems 
to contribute to continued staff enthusiasm at adopting scnools, 

In Wisconsin's program, statewide networks consisting of the state 
education agency, teacher education institutions , and school districts 
pypvide inservice training. When a school begins to Implement the 
program, some members of the building staff receive training in the 
funaatnentals of the multiunit organlration, and then they play an 
Important role in the training for the other staff members. Cooperating 
teacher education institutions hold Summer institutes for personnel 
from multi unit schools and are beoinning to provide academic-year 
courses as well. (The incentive of increased professionalism seems to 
help nurture school people's commitment to the innovation.) As /I/D/E/A/ 
sees Hi an Important reason for adopting I6E Is the opportunity for 
intensive staff development. With some guidance from a "Facilitator" 
at an intermediate agency, the staff makes up a plan for continual 
inservice training. "Leaoues" of IGE schools exchange ideas—and even 
personnel. Because this Is such a complex innovation, the developers 
recognized the need for implementation support consisting of training, 
problem-solving help, and continuing encouragement. 

Wisconsin is one of very few agencies that have kept careful records 
of the costs and results of various diffusion tactics. They have 
been ablj to revise their strategy in light of this information, 
One part of their expeqditure, the subcontracts to 1 ink 1r<g agencies, 
may not have been absolutely necessary; /I/D/E/A/, which has not 
furnished such incentives, has also set up a functioning network of 
intermediate agencies. 
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THE PRODUCT 



Individually Guided Education (IQE) stretches to the limit our 
definition of an educational product: to Implement this Innovation Is 
to effect a whole collection of changes In a coordinated fashion. It 
alters instructional methods and the relationships amonq school staff 
In the effort to work toward th6 two goals of individuaii zed learning 
and shared decision making. IGE launcheis a frontal attack on the tra- 
dition that gives one teacher autonoii\y in the classroom. 

Development and diffusion of IGE have been conducted by the Wisconsin 
Research and Development Center for Cognitive Learning and by /I/O/ E/A/ 
(Institute for Development of Educational Activities, Inc.), and the two 
agencies have come to define the innovation somewhat differently . For 
the R&D Center, IGE is a total system of education that they have only 
begun to develop. It also includes curricula and other emerging products 
liko motivational-instructional procedures. Its first component, the 
multiunit school , is the Innovation discussed in this study where the 
R&D Center's activities are concerned. The multiunit organizational 
plan replaces traditional , 25-pupil classrooms with larger, nongraded 
units. Each unit has 100 to 150 children in a three- to four-year age 
span, and Instruction is handled by a team of a unit leader, two or 
three Staff teachers, a first-year teacher, and an aide, helped by a 
secretary and an Intern. The unit leaders work with the ■building princi- 
pal as an Instructional Improvement Committee that defines the school's 
goals. Policy development and resource management are handled at the 
di$trict level by a Systemwide Policy Committee, which Includes principals 
and some unit leaders and teachers, along with central staff. 

For /I/O/E/A/, on the other hand, I6E is defined as a process of 
continuous staff development for schools. An organizational change very 
similar to Wisconsin's multiunit plan does take place in IGE schools 
working with /I/D/E/A/'s plan: there are large units of students called 
Learning Coninunlties and a Program Improvement Council for cooperative 
decision making among building staff. Staff development activities are 
also a part of Wisconsin's model; however, Wisconsin's IGE includes 
curricuiar components, and 1t is Wisconsin's multiunit school that corre- 
sponds roughly to /I/O/E/A/ 's IGE. 

To the R&D Center staff, the multiunit design represents an 
organizational change which restructures the school and thereby leads 
to greater staff cooperation and Individualized learning. To /I/O/E/A/, 
IGE is a teacher training program accompanied by organizational change; 
like the multiunit design, IGE has the objectives of staff cooperation 
and individualized learning. In other words, the two agencies seem to 
differ as to the relative emphasis given to the structural change and 
the inservice program. Still, since the R&D Center does provide heavy 
inservice support for the change, the difference is not a crucial one 
in practice. 
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ni^/tfhl i^nd the R&D Center also differ In the materials that they 
have developed for schools. /I/O/E/A/, contending that the presence of 
new curricular materials cannot substitute for inservice training in 
enabling teachers to implement IGE, has not developed any materials for 
classroom use. The R&D Center does not claim that Its IGE materials 
will automatically lead to change} however, it has developed a number 
of curricular products such as the Wisconsin Design for Reading Skill 

Itfi-v : Development. /I/D/E/A/, on the other hand, has engaged in relatively 
extensive development of materials for inservice training and has pro- 
duced a package costing between $250 and $450 which adopting schools 

M: must purchase. 

An integral part of this "product" is the Implementation support 
provided for adopters by linking agencies. Wisconsin has assisted state 
Mt departments of education in organizing statewide networks - corisisting 

of the state department itself .teacher education institutions, and 
school districts - and personnel from these networks help organize the 
workshops that accompany a school 's change to the multiunit plan. 
/I/0/E/A/*s intermediate agencies include the central offices of large 
school systems, universities, present and former Title III centers, 
^ regional laboratories, and archdiocese offices as well as state depart- 
ments. In each participating organization there is a "Facilitator," a 
staff member who coordinates the cooperative inservice efforts of eight 
to 15 nearby IGE schools. 



DEVELOPMENT 

Wisconsin R&D Cent er 

Target users worked with developers in the initial planning of the 
multiunit school . The product's history can 6e traced back to the meet- 
ings in 1964-65 Of a Schools Planning Group comprised of people with 
three different perspectives: the group included representatives from 
the R&D Center, the State Department of Public Instruction, and 13 school 
districts in Wisconsin. At their meetingi, the group searched for ways 
of coping with problems and sustaining innovations in tHe schools. Re- 
flecting on the concerns .and ideas that had been voiced, Dr. Herbert J. 
Klausmeier of the Center decided that a new plan of organization for 
school would facilitate improvement. Development then began on the 
concept of nongraded "Research and Instructional Units." 

The innovation was intended as an "umbrella" to cover and combine 
several related changes, including team teaching, differentiated staf- 
fing, accountability (through ongoing examination of successes and 
failures), shared decision making, and individualized instruction. De- 
velopers pointed to the desirability of making a number of changes at 
once, and they still mention that the school people brought together in 
1965 expressed a wish for overall change that could help them avoid the 
pitfalls of piecemeal reform. 
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From 1965 until 1968, the concept of I6E remained flexible as It 
was tested In schools. At first one goal was to allow more research in 
the classroom, much of It conducted by the teacher, but eventually this 
Idea was Subordinated to the goal of Individualized learning. Roles for 
staff members c&m to be defined In more specific terms as the model 
evolved, 

^The "field tests" for the multlunit school could not consist of 
brief exposures to the "producfj In order to use It, a school had to 
spend a year or more Implementing the changes. In this special situa- 
tion. Center staff members realized the Importance of testing the pro- 
duct S Implementation procedures. 

- Formative evaluation had four areas of focus: the feasibility of 
Implementation procedures, attainment of organizational objectives, the 
IGE reading comnonent (a currlcular package Including dlagnostlc-prescrlD- 
tlve techniques), and cost/benefit estimates. Observation, structured 
Interviews, and questionnaires were the procedures used. 

As fifty schools in Wisconsin began using IGE, Center staff observed 
the operations of the instructional units and of the buildings' Instruc- 
tional Improvement Committees. Evaluators concluded that progress was 
being made toward meeting the organizational and Instructional criteria. 
They also pointed to the diffusion of the multlunit model, from seven 
entire schools in 1967-68 to fifty in 1969-70, as evidence of the inno- 
vation s feasiblity. Some problems were found at the district level , 
where administrators tended to use traditional decision-making patterns 
instead of the Systemwide Policy Committee. 

Another evaluation team, from Oregon's Center for Advanced Study of 
Educational Administration, used structured interviews and questionnaires 
In six schools, three of them multiunit and three controls, to study the 
attainment of organizational/administrative objectives. They found that 
the multiunit schools were making progress in the areas of task structure, 
working relationships, decision-making structure, and job satisfaction. 

There have been many other programs of evaluation, which are described 
at length in Wisconsin R&D Center publications. The major programs sum- 
marized here are outlined -in more detail in Technical Report No. 158, 
The Development and Evaluation of the Multlunit Elemen tary School , 1966 
to_l970, by Herbert J. klausmeier et al. 

/I/D/E/A/ 

/I/D/E/A/ staff members, too, have done developmental work with IGE. 
Although some of the original ideas came from Wisconsin, /I/D/E/A/ has 
conducted Its own program of research and development in the area of 
change in schools. Much work in nongraded instruction has been done by 
John Goodlad, who directs the Research Program in Los Angeles. The Re- 
search Program has studied the process of innovation, while the Innnya- 
tive Programs staff in Dayton, Ohio has been putting together materials 
and procedures for the implementation of IGE. In 1969, /I/D/E/A/ and 
the R&D Center agreed that they would both work with this innovation. 
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/I/D/E/A/ has produced materials for Implementation assistance, In- 
cluding a set of 15 fllmstrlps with audiotapes, a study guide, and 11 
other print documents, with a price of $250 to $450. Four films have 
also been produced and are ^^sed^by^ntermedlate agencies. 

Development of these materials got underway In 1969, as one step 
in the evolution of /I/D/E/A/ staff members' theories about change In 
schools. The director of Innovative Programs explains the progress of 
their theories In this way: At first they believed that change could 
best be stimulated by outsiders going into schools. Next they became 
more Interested In new materials as aids in change, and It was at this 
point that development of the Inservlce package was begun. When new 
materials seemed Insufficient, the developers advocated a combination 
of consultants and materials. Now they are convinced that outside In- 
fluence alone Is unable to produce change and that the best change re- 
sults from Inservlce training that Is managed from Inside the school, 

Evaluation by /I/D/E/A/ did not begin ur.til 1972, when It was felt 
that the "product" of IGE had taken shape. Instruments have been devel- 
oped for teachers and observers to rate practices In a school for their 
consistency with IGE objectives. The Instruments have been tested with 
samples of up to 600 schools. As of mid-1973, there was good reliab-ility 
among outside observers and a constant amount of difference between ob- 
servers and teachers. Another study has been started by a public opi- 
nion polling firm, examining attitude change over time among students, 
teachers, administrators, and parents. 



DIFFUSION 

All things considered, IGE is not an innovation that can be adopted 
easily. Disseminators at both agencies have planned for heavy implemen- 
tation support to be provided by linking agencies that form close tier with 
the schools. The multi unit plan 1s most readily Implemented by a school 
that can be served by an existing linking agency: a participating state 
department of education, school district, university. Title III Center, 
or archdiocese office. To adopt and Implement the multiunit organiza- 
tion, a school enters into a signed agreement to cooperate in the inser- 
vlce training program, and a series of workshops and institutes for 
learning about IGE then begins. In order for staff members to partici- 
pate in these, avail themselves of consulting help from the linking agency, 
and cooperate with other adopters, a school should be located near the 
intermediate agency. 

Wisconsin R&D Center 

From the time when the first nongraded units were set up in three 
Wisconsin school districts, inservlce training has been a vehicle for 
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development and diffusion. In 1966, summer institutes for graduate 
credit brought teachers to universities, where they studied techniques 
for conducting research and Improving instruction. Professional develop- 
ment for teachers is still a cornerstone of the R&D Center's impTementa- 
tion strategy. 

The Wisconsin State Department of Public Instruction was an early 
participant in the growth of I6E, thus setting a pattern for the con- 
tinuing reliance on linking agencies. As schools began to make th^ shift 
to the multi unit organization, state department personnel helped to pub* 
licize the Innovation, And in 1968-69, it was the state department 
that set up a demonstration project for the multi unit school. In this 
project, organized in cooperation with four teacher education institutions, 
eight "lighthouse" multiunit schools were established and educators were 
encouraged to visit them. By the end of the year, there were 35 new 
multiunit schools in Wisconsin. 

The major diffusion program for the multiunit school was funded in 
1971, when the Wisconsin R&D Center received $642,000 per year for two 
years from the National Center for Educational Communications (NCEC), 
the Bureau for Educational Professions Development (BEPD), and the National 
Center for Educational Research and Development (NCERD). The strategy 
for implementation is based upon a network that links the R&D Center 
with state departments of education, local school districts, and 
teacher education institutions. Much of the federal funding has been 
used in subcontracts with these agencies, which carry out proorams de- 
signed by the Center that range from one-day workshops to full academic 
year degree programs. The establishment of statewide networks of SflA's, 
LEA'S, and universities reflects the desire of the Center staff to with- 
draw from participation as the I6E system is put into practice in schools. 
They believe that their mission is to engage in research and development, 
and that other agencies, given some guidance, are best equipped to 
create the "facilitative environment" that allows I6E to take root. 



Diffusion activities were organized into a four-phase model : 

"awareness 
"implementation 

"refinement of concepts and practices 
^'institutionalization 

This model reflects the long-range view taken by the Center staff in 
that a substantiar portion of the implementation grant was spent 
on graduate-level degree programs and inservice institutes. 



29 



AMfiinesa. The first step in the awareness phase, in spring 1971, 
was a direct mail campaign in which 29,058 eight-page brochures were 
sent out nationwide. The primary target audience was elementary princi- 
pals't secondary audiences consisted of superintendents, elementary co- 
ordinators, and people from university schools of education and state 
education agencies. A follow-up study suggested that for at least 
10,000 recipients, or about one-third, this mailing was the first ex- 
posure to IGE. The brochures included reply cards, and 801 of the 
29,058 were returned (a rate of 2.8 percent), 

Respondents were sent copies of a more detailed booklet and were 
Invited to Information-giving conferences. The objective for these one- 
day conferences was to supply decision makers with enough understanding 
of the multlunit school that they could either decide to adopt it or re- 
quest other data they needed. The conferences ultimately drew a total 
attendance of close' to 500 at five sites chosen for their convenience to 
the interested people: Washington, D.C.; Atlanta;- Madison, Wisconsin; 
Lincoln, Nebraska; and San Francisco. Information was presented by a 
developer and a user of the program. A second series of awareness con- 
ferences is being held in eight locations around the country in 19?4. 
R&D Center staff members are conducting these conferences, but other 
agencies in the implementation network are also assuming responsibility 
for awareness activities. 

ImpZmentation. Activities in the second phase, implementation, 
began in 1971-72 under subcontracts with nine state departments of edu- 
cation. Each one agreed to install and service a specified number of 
multlunit schools by obtaining written commitments from schools, provi- 
ding training and consultant services, establishing a cooperative net- 
work of schools and teacher education institutions within the state, 
and participating in an evaluation of the results. 

The implementation phase began when a school made an initial commit- 
ment to use the jnultiunit design. Before training began at the building 
level, administrators and central office personnel attended a one-day 
workshop to prepare them for leadership In the change process. The next 
step was a three-day workshop for building principals and prospective 
unit leaders. The staff members at the district and building levels put 
their training to work just before school opened in the fall, when they 
conducted a three- to five-day workshop for the entire building staff , 
with assistance from Center personnel or linkers. Then, throughout the 
year, the building staff members developed their skills In a series of 
four half-day inservice sessions. The first workshops in a state or 
region were conducted by the R&D Center staff, assisted by a coordinator 
from the state IGE network, who directed later workshops alone. 

The R&D Center developed some materials for use in this phase. 
A paperback book entitled Individually Guided Education and the Multi- 
unit Elementary School ; Guidelines for Implementation , written in 1971 
and revised in 1974, gives an introduction to the structure of a multi- 
unlt school and the techniques for implementing it. The developers also . 
offer a film, six filmstrips with audio tapes and print guides, trans- 
parencies, and nine other print documents. 
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* ''ff^«^«"*' I" the refinement phase, experienced personnel from 
?^-H"2^^S^^^?i^^"fl???^ week-long institutes on unlversitrcaiipuses 
to f'lejgthen^thelr skil s. Sample topics of study for unit leaders 
included: writing behavioral objectives, planning and carry i no out 1n- 
cfr^?^l2!!2 PI;;^^^'f ^'^?^'^^^?§ ^'-oup dynamics tecRnlques, and planning 
staff development for the unit. Seven universities received subcbntract 
to conduct these institutes. Teacher education Institutions participa- 
tlnjj in the state IGE networks are continuing to provide this support 
to .'{choo personnel. Wisconsin staff members designed this phase to 
forestall a loss of commitment once the novelty of the Innovation wore 

Q T T • . 

ImtituHomlization. The fourth phase of the developers' model 
is now undergoing some change. Initially, four teacher education In- 
stitutions set up fellowships for year-long degree programs in the con- 
cepts ana practices of IGE. But the programs were expensive, and only 
38 individuals received fellowships. Because of the high per-person 
cost of this approach, alternative ways of building IGE into the pre- 
service curriculum are now being developed. Some universities now offer 
courses related to IGE, and the University of Wisconsin is planning a 
project to develop training materials for preservice use. This new 
project has been granted three-year funding of $1,300,000 from the Sears 
Roebuck Foundation for the development of multimedia materials for the 
undergraduate and graduate levels. 

/I/D/E/A/ 

In 1969. /I/D/E/A/ and the R&D Center drew up a one-year agreement 
under which /I/D/E/A/ began to produce tnservlce training materials for 
IGE. Since that time, the /I/D/E/A/ diffusion plan has evolved separate- 
ly and has become distinct from the Center's plan, with the development 
of new materials and strategies for implementing schools. Although the 
agencies have cordial Interactions, there are areas of disagreement re- 
volving around: 1) the inservice materials to be provided to adopters. 

for Inservice training, and 3) the financial arrangements 
with linkipg agencies. 

The materials developed by /I/D/E/A/ have been described above j they 
are multimedia in nature, cost between $250 and $450 altogether, and must 
•be purchased by participating schools. Wisconsin has developed some less 
expensive materials, 

A second difference between the two diffusion strategies is that 
the /I/O/E/A/ program for implementing schools relies less on systematic 
help from outside agencies, such as teacher education institutions, for 
Inservice training. Instead of scheduling a set of workshops for imple- 
mentation and efinement, /I/O/E/A/ strives to encourage perpetual staff 
development which is coordinated by linking agency personnel but which 
derives much of its impetus from the schools themselves. 
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A third difference between the strategies of the two agencies is 
that, unlike the Center, /I/D/E/A/ does not award funds fo the inter- 
mediate agencies with which it works. Some 80 agencies have entered in- 
to an agreement with /I/D/E/A/ under which each provides one full-time 
"Facilitator" to work with a League of eight to 15 schools in its geo- 
graphic area. The expenses of the Facilitator's salary and a full set 
of inservice materials are borne by the iriLermediate agency. This policy 
is based upon the belief that if an agency is funded for two years, 
there is no guarantee that it will continue its work for five years » 
and that in fact it is highly unlikely to do so. 

How does /I/D/E/A/ 's implementation program for I6E operate? Before 
a school embarks on the program, the principles of IGE are fully dis- 
cussed with everyone who will be involved. Since community support will 
be important, staff members from /I/D/E/A/ or a linking agency, when in- 
vited in by a district, first hold a "Clue-In Conference" for the lay 
public and the school board. This conference, which is directed primar- 
ily to laymen, is followed by an overview for professional personnel in 
a school— the superintendent, principal, and key staff. At this one-day 
session the objectives of training in IGE are presented and discussed 
so that the school staff members can decide whether these coincide with 
their own philosophy. 

If a school decides to use IGE, it enters into a formal agreement 
with an intermediate agency, thereby joining a League of schools. Along 
with personnel from five to eight other schools, the principals and 20 
percent of the staff take part in an inservice workshop that Is held in 
clinical conditions in still another school. (It is preferable for this 
school not to be a user of IGE, since what the teachers and principals 
are trying to learn is the process of changing old practices.) During the 
two-week-long workshop, trainees work with children in the mornings, then 
spend the afternoons evaluating their progress and charting the next day's 
activities. At the end of this time, they plan the inservice program for 
the rest of their building staff. 

The training process continues throughout the year, primarily through 
teacher-to-teacher interaction. Personnel from the intermediate agencies 
do seme consulting, but /I/D/E/A/ feels that programs such as school staff 
exchanges can be more productive. In the staff exchanges, a few taachers 
from one school may spend as long as a week at -.lOther school observing 
the problems and solutions and discussing their own experiences. The 
principal is supposed to take an active role in the Inservice program; for 
example, an /I/D/E/A/ publication suggests that when a problem arises in 
a school, the principal and the Facilitator can jointly plan a small in- 
service project to work toward a solution. - 

The staff training is individualized, in accordance with IGE principles. 
/I/D/E/A/ h?.s listed 35 outcomes or objectives for the training, but school 
personnel determine their own way of progressing toward these objectives. 
The pace of Implementation may be slow. At first IGE might be used in a 
portion of the school day, perhaps in one subject area, and by the end of 
the year half of the school might be using it in all subjects. 
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It can be seen that Wisconsin and /1/D/E/A/ are In fundamental 
agreement about the diffusion of IGE, despite their differences. Both 
plans emphasize Implementation support* featuring staff training, which 
Is coordinated by linking agencies, In fact, future directions for 
both agencies seem to be bringing their programs Into closer allgnmeit* 
/I/D/E/A/ personnel have begun to work with teacher training Institutions 
to study the use of IGE In preservlce settings, Meanwhile, In 1972-/3 
the Center's linkage system adopted some of the arrangements that 
/I/D/E/A/ has originated. For Instance, the Center set up statewide 
leadership councils which Included IGE coordinators from local districts, 
who would be able to give more help to the new multlunit schools than 
state department personnel alohe could supply. And some state departments 
of education organized leagues of schools to monitor the schools' 
Implementation and to gather feedback from them. 



IMPLEMENTATION FIGURES 



In 1973-74, there were 1,600 multlunit elementary schools In 34 
states. Some have worked only with the R&D Center, some only with 
/I/D/E/A/, and a large number have had contact with both agencies, For 
example* the IGE coordinator In Wisconsin has participated In the two 
kinds of training programs, and he uses materials from both organiza- 
tions in conducting inservice training for schools in the state. Thus 
it is not possible to separate the results of the two dissemination 
strategies* 

In order to estimate the 'Wrket share" that has been attained by 
IGE, we can use the total number of public elementary schools in the 34 
states. (It would not be fair to say that the market consists of all 
the elementary schools in the country, since implementation is based on 
contact with linking agents, and there are no agents in the other 16 
states.) On this basis, there is a total market of about 56,000 ele- 
mentary schools. The 1,600 multlunit schools represent almost three 
percent of the market. 

Does this figure represent successful diffusion? It seems 
inappropriate to use comnercial publishers' market shares as a standard 
of comparison, since IGE Is not in the same product class as instruc- 
tional materials. It is not even a product at all; instead it is a 
change in the structure of a school. In thfejabsence of a better standard 
of comparison, we can only point out that five percent would be a 
respectable market share for an instructional product, and that IGE's 
three percent therefore seems to qualify as successful. 



' Digest of Educational Stati stics, 1972 Edition. U.S. Department of 
Health, Education, and Welfare. Table No. 10, p. 12. 
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DISCUSSION 



Desig n 

The development of this particular innovation does not represent 
a mismatch between objectives and form {as may have been the case with 
other innovations). The objectives are no more sweeping than the 
organizational change and the inservice training program that are 
desianed to lead to their attainment* If the staff of a school are 
willing to work for the comprehensive set of outcomes from teacher 
cooperation to individualized instruc'oion, it is likely that they 
will be willing to accept the substantial changes caused by adoption 
of IGE. 

The complexity of the change to a multiunit plan seems to hold 
appeal for some adopters, A Center staff member explains that many* 
educators have seen the instability of piecemeal innovation and there- 
fore look for a way to build a comprehensive structure for change. 
According to the /I/D/E/A/ staff, one of the foremost advantages of IGE 
is the implementation process^ in which teachers and administrators take 
part in clinical inservice training before the school year begins and 
the school Joins a League of implementing schools in its area to exchange 
help and support. 

However, the complexity of the change can obviously be a barrier 
to adoption. The shift to the multiunit organization is a disruptive 
process requiring a redefinition of roles at all levels of the school's 
staff. A staff member at the R&D Center says that teachers can feel 
threatened by tlie team approach, since they may worry about exposing 
their weaknesses to colleagues. And because the change is complex, it 
demands a sustained level of commitment, Unless staff members agree 
with the philosophy of IGE and are willing to work conscientiously for 
it, they will not implement it. Therefore the Center and /I/D/E/A/ 
have devised systems of checklists and formal agreements to preclude 
too-casual adoptions. 

School people sometimes express a concern that parents in their 
district will oppose the multiunit plan. The developers at Wisconsin 
state that parents usually react enthusiastically when the change is 
made, but they are now working on a program for home-school -community 
communication that should, help to counter school people's fears of 
negative community reaction. 

Field Testing and Marketing 

The field testing of IGE avoided some coirmon pitfalls by virtue of 
the unusual nature of the innovation. It simply was not possible to 
bring a group of people together, give them a brief experience with the 
product, and assess the results. Instead the multiunit design was imple- 
mented in a number of Wisconsin schools over a period of at least a year. 
The reaction of potential users was gauged by the evidence that the 
innovation was being adopted by other schools. The adequacy of its 
operational procedures was, of course, a central issue in the field 
testing. All the relevant decision makers in a school were involved 
in field testing, since it was recognized that there would be many 
important users and facilitators. 
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One problem that we have identified did not appear to be resolved 
in the R&D Center's field testings they worked with schools that were 
disposed to use the product. One might argue that given the test stra- 
tegy of studying actual users, they could hardly have worked with anyone 
else. However, the need for the multlunit model was Initially Identified 
In cooperation with a select group of people from schools, and it was 
these people who formed the nucleus of the test users. Perhaps a needs 
assessment survey or a more intensive study of non-adopters would have 
yielded important information. 

Diffusion Strategy 

In light of our other case st,udies, it seems probable that one impor- 
tant reason for the success of I6E was a recognition of the innovation's 
complexity, which lead to careful planning for its diffusion. The R&D 
Center and /I/D/E/A/ may have been; fortunate In having a product that 
was not a tidy package but obviously required a supporting structure of 
Implementation assistance. Because of the complexity of the change they 
hoped to produce, they set up networks of intennediate agents to provide 
the necessary support. These people viewed I6E as a change process, not 
as a simple product to be passed on to schools. 

Awareness Efforts 

Although the bulk of dissemination funding has gone into implementa- 
tion support, Wisconsin's 1971 awareness campaign deserves analysis. It 
illustrates the expense of such efforts and the apparently low payoff that 
must be expected. The Initial mailing went to nearly 30,000 people; 800 
cards {three percent) were returned, and about 500 people (two percent) 
attended the information-giving conferences. However, we do not assert 
that awareness campaigns are a waste of money. Even though few adoptions 
may result directly, a great many people are introduced to the existence 
of the product— and awareness is, after all, an indispensable condition 
for adoption. Whit seems important is: 1) that awareness efforts be 
targeted to tiiu „\,c appropriate audience, and 2) that the first exposure 
to the product be followed up with more information. Although Wisconsin 
staff members point out that this mailing was more successful than those 
of most commercial companies {who>they say, usually expect about a one 
percent return), it Is possible that the use of market segmentation 
techniques would have yielded a more limited and efficient mailing list. 

Opportunity for Trial 

There has been no formal , nationwide program to set up IGE demonstra- 
tion sites, although the demonstration approach seemed to produce good 
results in Wisconsin in 1968-69. On an informal basis, coordinators 
encourage potential adopters to visit successful multlunit schools. The 
follow-up for people who responded to the Center's Initial mailing was an 
Information-giving conference. If participants in a conference wanted a more 
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direct experience with the Innovation, they could attend the first 
Inservlce workshop, The Center's report on the awareness conferences 
Indicates that almost half of those who had not yet decided whether to 
adopt the multlunit model were conslderlna attending a workshopi this 
finding suggests a need for a trial experience with the product. " 

Linking Agencies and Incentives 

The different strategies of Wisconsin and /I/D/E/A/ raise an Inter*' 
esting question about Incentives for linking agencies. Wisconsin spent 
roughly half a million dollars on subcontracts to state departments of 
education, while /I/D/E/A/ awarded no subcontracts. Instead, /I/D/E/A/'s 
linking agencies have used several different financial arrangements with 
the schools they have helped In Implementing I6E: some regional service 
centers regularly charge a fee to schools In their area; some universities 
have made commitments to provide inservlce training to r^earby schools: in 
some cases tuition has been charged for the inservlce work and partici- 
pants earn graduate credit. These alternative arrangements suggest that 
Wisconsin's subcontracts might not have been necessary. Still, a good 
record of adoptions did seem to result from the subsidized state depart- 
ments' involvement— and It should be noted that Center staff members have 
in the past been philosophically opposed to asking users to pay for imple- 
mentation support, although other options are currently being considered. 

Training 

The cornerstone of IGE implementation is inservlce training, 
Wisconsin has used the incentive of professional development to encourage 
experienced multiunit teachers to return to the university campus regularly 
and continue their inservlce work. But in the view of the /I/D/E/A/ 
staff, the first year of Implementation is the most critical time for 
training; they do not feel that the Wisconsin program of workshops in 
the implementation phase gives teachers enough grounding in IGE. In 
either case, though, more training accompan-.es this innovation than almost 
any other we have studied. 

Problem Solving 

Another important service for adopting schools is a system of problem- 
solving help. The networks of intermediate agencies provide people who 
know the difficulties of implementing IGE and can suggest ways of meeting 
these difficulties. At the same time, the fact that an adopting school 
is not abandoned when the product Is purchased helps to sustain the 
interest of the staff. The continuing relationship with a state depart- 
ment or a league of schools seems to motivate the staff to direct their 
energy and creativity to implementation. 
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Monitoring 

Quality assurance has been exercised, at least to some extent, by 
both agencies. A team from the k!iD Center visited a sample of 20 percent 
of the multiunlt schools in 1972 to determine how smoothly implementation 
was proceeding. /I/D/E/A/» in the course of developing and refiniric| 
evaluation techniques, has measured the extent of I6E implementatloh in 
samples of up to oOO schools and has sent the resulting data back to the 
schools and facilitators. 

Cost Effectiveness 

In contrast to most other agencies, the R&D Center has kept carieful 
records of the costs and outcomes of diffusion tactics and has used this 
information to alter its plan as necessary. Attention to costs, adoptions, 
and implementations was required under the terms of the 1971 diffusion 
grant. 

The following breakdown summarizes the costs and results associated 
with each phase of the strategy over the two-year period. 

AwoT'emsa. There was a separate grant from NCEC for this effort, 
which took place only in the first year. At a cost of $22,200, a total 
of 29,058 brochures were sent out. Of these, 801, or 2.8 percent, were 
returned. About 500 people attended the information- giving conferences. 
Hence the Center spent $58 per person attending a conference. 

imptmentaHon. Over two years, the subcontracts, staff salaries, 
travel expenses, and management costs totaled $660,340. The nine state 
departments of education that received subcontracts brought about a 
total of 630 adoptions. The cost was therefore $1,048 per adopting 
school. 

Refinement, All costs related to this phase amounted to $235,840 
for two years. The result was one-week training institutes on seven 
university campuses for 1,200 people, including 700 unit leaders, 300 
principals, and 200 staff reading teachers. The per-person cost to the 
Center was $196. 

InsHtuHonaUzabion. The fellowship program was financed with 
money from both funding years, although it was in effect for only one 
academic year. The cost was $243,000 to give fellowships for a year 
of graduate study to 38 people: 24 unit leaders, 9 principals, and 
5 reading teachers. Each fellowship thus cost $7,448. The R&D 
staff became aware that the institutionalization phase was very expen- 
sive, and they have since devised a different way to build I OE into 
the preservice curriculum. 
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PRODUCT SUMMARY 



Product nmet Research UtIIUIng problem Solving (RUPS) 

Dmlop&i^i Northwest Regional Educational Laboratory (NWREL), Portland 
Oregon 

DietHbutot^i Commercial- Educational Distributing Services 

DeaoHption: Research Utilizing Problem Solving Is a 33,5 hour Instruc- 
tional program designed to provide teachers and administrators with 
$kms that will enable them to analyze sUuations, consider, alterna- 
tives, and make decisions. The two versions that are available, for 
administrators and teachers, also Include lessons to promote the 
growth of teamwork. 

The Classroom Version of RUPS was released commercially In March 1971, 
the Administrators Version In July 1973. Each version consists of 
a leader's guide, participant materials, and an audiotape and text. 
Throuqh a series of work$hop activities, participants first learn to 
cormtly Identify a problem, then to diagnose^ the problem situation, 
to consider alternatives, to test plans, and finally to evaluate and 
update the plans. 

Target mvkett Although elementary and secondary teachers and admini- 
strators are the primary target audience, the program has also been 
used with paraprofesslonals, students, volunteers, and parents. 
Governmental agencies, business, and Industry have also requested 
RUPS training. Target buyers are generally superintendents or members 
of a central district staff. 

Coet! Participant materials for the Classroom Version cost $9.20, and 
for the Administrators Version, $13.10. Reusable leader's .materials 
cost $12.00 for the Classroom Version and $12,20 for the Administra- 
tors Version. Materials are easily duplicatedj the developers say 
they think this happens frequently, especially since most components 
of the package are not copyrighted. 

Schools must supply the following materials, personnel, arid funds to 
implement the course: 

Tape recorder 

Trainer, through one of the following: 

— Contract with regional training representative 
(consultant fee of $100-$150 per day for five 
days) 

Contract with experienced participants 
(consultant fee) 
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" Contract with developing agency 

(consultant fee, overheadi travel expensesi 
per diem) 

Local university or college 

(summer workshop on campus or consultant contract) 

" Development of cadre of own teachers 

(initial expense of training core group of trainers 
through any of above) 

Substitutes (If course Is conducted during school hours) 

The only set cost per user Is for participant materials, portions of 
v;h1ch can be duplicated- Aside from this minimal amount, costs vary 
depending on whether substitutes are hired and on trainer costs. The 
least expensive method is to offer the course during the summer or 
after school, using district teachers as trainers. 

Eoatuation: The main field test of RUPS was conducted under condition^ 
as similar as possible to those that were likely to exist when the 
product was released for distribution. Each site contacted the Labo- 
ratory, chose participants, and paid expenses, Seventy-six percent 
of all participants rated the workshops positively on three scales 
of worthwhileness, on the degree to which expectations were met, and on 
the extent to which they would recommend RUPS workshops to others. 
In a comprehension test administered at the conclusion of training, 
87 percent of the communication concept items and 67 percent of the 
problem-solving concept items were correctly answered? by more than 
75 percent of the participants. The report concludes that "... 
the workshop was effective in helping trainees acquire problem-solving 
skills and concepts of communication relevant to effective teamwork." 

The Laboratory conducted a six-month follow-up to study the use of 
training. The report points out that there is no predictive validity 
between post-training scores and use of training. In other words, 
those who acquired problem-solving skills during the course did not 
necessarily use those skills in the school setting, Better predictors 
of use seem to be team participation in the training and the match 
between the materials and group interests. 

The field test did not attempt to document the quality of RUPS train- 
ing in classrooms and Its benefits to schools and students; future 
studies will attempt to assess these two factors. 

Cuvvent statue: All elements of the RUPS package have been developed; 
materials are available from a small printer, Commercial-Education 
Distributing Services. As of August 1972, 4,481 teachers and administra- 
tors had been trained in RUPS. 
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Innovative effeota: RUPS training takes 33.5 hours to complete, 
If workshops are held during school hours, scheduling changes must 
occur. Although the program Itself Is Inexpensive, teacher released 
time 1s costly and may cause changes In budgeting patterns, especially 
since staff training Is an area for which little money Is traditionally 
allocated. Developers stress that most graduates are qualified to offer 
training to others. Although administrators are generally more apt 
to retrain others, some teachers may also accept this role leadina to 
some change in authority relationships. The main goal of the training, 
the development of problem-solving skills, may ultimately lead to ex- 
tensive changes in a school system. 

Synopsis of diffusion: With RUPS, the Northwest Laboratory has pioneered 
a methou of do-it-yourself dissemination; the program is hiahly struc- 
tured, with unusually complete directions for its use, and it is 
assumed that most trainees can become trainers themselves. In theory, this 
would lead to infinite diffusion of the program. And in reality, it 
has apparently led to good results. 

Once a small cadre of personnel in a district has participated in RUPS 
training, the entire staff can be trained. To begin the process, the 
district can arrange for a consultant from the Laboratory or from a 
local college, or can contact one of the 18 regional training repre- 
sentatives. These representatives are responsible for most of the 
program's dissemination, although the Laboratory does conduct several 
different kinds of awareness efforts. The representatives are given 
a great deal of autonon\y— in part because bringing them all together 
for a meeting would be quite expensive. 

No large publisher would accept RUPS without, air) taking on control 
of the training and thereby raising costs to Lhe jscr significantly* 
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THE PRODUCT 



Twelve teachers listen intently as the RUPS trainer turns on a tape 
recorder: "The group this year Just can't seem to get going. It isnU 
a matter of intelligence, they just don't seem to want to work. For 
some reason or other, they're dragging their heels all the way and I 
don't know how to lead them. I want to do something but I don't know 
where to begin. What can I do?" 

The Northwest Regional Education Laboratory (NWREL) attempts to pro- 
vide a process for arriving at alternative answers through a product they 
call Research Utilizing Problem Solving. Each version of the materials, 
one for teachers and another for administrators, consists of a leader's 
guide, participant materials*, an audiotape, and text, in a series of 
workshop activities lasting 33.5 hours, teachers. and administrators 
learn teamwork skills and problem-solving techniques— either to help a 
fictitious teacher, Mrs. Jones, solve her classroom problems, or to help 
a fictitious administrator promote sharing among teachers. The program 
introduces step-by-step procedures for identifying and solving specific, 
problems. For example, in one lesson teachers aid Mrs. Jones In achiev- 
ing her goal of helping children to become more active learners. During 
training sessions teachers, working in small groups, learn to gather and 
use data, develop alternatives for action, and plan for the introduction 
of change. 

RUPS is more than a series of tricks to make teaching easier. The 
developers are attempting to equip teachers and administrators with skills 
to enable them to use the vast storehouse of researcli knowledge that a 
technological society provides. NWREL is also trying to teach partici- 
pants how to apply a research process for analyzing their educational 
settings. D.evelopers contend that this training in the effective use of 
research techniques will enable teachers and administrators to promote 
real changes in their schools. 

The program evolved from strategies developed In Michigan during the 
1960s while the current program director was working at the University of 
Michigan and with the Cooperative Project for Educational Development (COPED). 
During this period he and other COPED members studied the importance of the 
teacher or administrator as a change agent. 



DEVELOPMENT 

The RUPS project director. Dr. Charles Jung, saw the need for problem- 
solving training in the early 1960s while developing youth programs in 
Michigan. Even though evaluations showed that they were effective in help- 
ing alleviate problems such as delinquency and teenage pregnancy, tho pro- 
grams soon disappeared. Jung explains that while teachers and administrators 
had solved problems, they seemed to be unaware of the general process that they 
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hdd used I teachers didn't have the opportunity to reuse and absorb their 
new program-developing skills. Charles Jung continued consulting with 
teachers, but he went on thinking about the way teachers work toward 
improvements In education and wondering how to transcribe that process 
into a program with universal applicability. He was already aware of 
some problem-solving methods that worked; at the University of Michigan 
he had studied under Dr. Ronald Lippitt and other educators who had de- 
veloped techniques for successful problem analysis and solution. 

wi.wSi'^^l'u^^^ P^?^®! °f P""l® t'egan to come togethert he recalls 
vividly the day he decided that probllm-solving and team skills cou d be 

S omMfiino lll''^^' ^''"^n- belieSL that Wa ects of 

fiKr^pn?^! JhJ?"^ ^""^^^^ ^ don't," and estimates that 70 to 
80 percent of this process can be taught to all teachers Mp pynfoHit/ 
approached one of his colleagues wlth^ls idea fo? a priduct thSt coJld 
be used by teachers to train other teachers in the processerof problem 
?lvl3^;roI L'f f°?'' ""^ "^'^'^^y* "Impossible " His col eague be- 

fom and ?oi dl?? rul? T^^"'' f '^^^^"^ ^^P*"^ ^" P»'oduct 
Torm and too difficult to convey in a short series of lessons. esoeHallv 

when they were to be taught by teachers who were nov1ceriS ?he field! ^ 

Undaunted, Dr. Jung continued assessing the possibilities for the 
product. In the late 1960s, he served on the executive conmlttee of the 
Cooperative Project for Educational Development (COPED), which was funded 
by the U.S. Office of Education for three years. Working cooperatively 
with the National Training Laboratories, the group of leaders in knowledge 
dissemination initiated inservlce training programs for university-based 
interns and for consultants of school systems and education associations. 
During the years he spent with this project, Charles Jung began working 
with the pieces of RUPS that had already been developed, and the COPED 
and national Training Laboratory personnel tested a prototype of RUPS on 
a team of teachers In Michigan. There were difficulties with the nine-day 
model; trainees working on their own programs became so Involved with 
their particular problems that they lost sight of the overall process. The 
trainees themselves suggested that the course might be more effective if 
they all worked with a simulation rather than their own problems until 
they had a good idea of the process. 

The system was modified to Include a simulation and tested with the 
Association of Classroom Teachers during the surnner of 1967, but further 
development was delayed; Charles Jung had come to the NWREL and was con- 
cerned about other projects during that year. During 1967 the Laboratory 
conducted an informal needs assessment in the northwestern region and de- 
cided that their clients would benefit from the development of a teacher* 
training program. Rather than concentrating on subject areas, the Labora- 
tory chose to create a pre- and inservlce training program to develop skills 
that would help teachers apply educational research and technology. RUPS 
became one element in what NWREL calls the "Improving Teaching CompeteKcies 
Program." By the end of 1972 nine elements of the total program had been 
completed and nine more were under developnent; NWREL estimates that the 



ERIC 



46 



total Impifoying Teaching Competencies Program of 20 units will be avail- 
able In 1976. 

Fiel d Testing 

Because many elements of the RUPS program grew out of earlier experi- 
ments, It has a long history of Informal field tests. A preliminary ver- 
sion containing some aspects of the program was field tested In collabo- 
ration with the National Board of Ed'jcatlon of the Methodist Church. The 
product was further tested at three annual conventions of the American 
Association of Classroom Teachers and In public schools In Atascadero, 
California. NWREL, NEA, the Oregon Education Association, the Washington 
Educational Association, and Central Washington .State College all partici- 
pated in the final revision of two versions of the program. 

In the final field tests, an attempt was mde to set up a realistic 
appraisal of the product and Its future dissemination strategy. Those 
educators who participated contacted the Laboratory because they had heard 
of RUPS training and were Interested in taking the course. NWREL did not 
provide free materials or training; participants covered all costs. In 
addition, it was the sites rather than the Laboratory who selected the 
trainees. The Laboratory expected that these realistic circumstances would 
shed light on the commercial dissemination pattern they could expect for 
the product. 

Field-test participants Included teachers and administrators from 
Montana, California, Washington, Idaho, and Texas, as well as a group of 
educational researchers drawn from throughout the United States, Evalu- 
ation of the program was based on questionnaires and exercises completed 
by participants br'ore training, itrmediately following training, and six 
months later. Th je sets of questions dealt with the acceptability of 
the program. Seventy-six percent of all participants rated these attri- 
butes positively on three scales. Seventy-seven percent of the partici- 
pants rated the training positively on four scales related to the content 
of training: "The extent to which it offered new insights, its relevance 
to 'real' issues, and its inmediate applicability to practice and the 
extent to which it demanded original thinking." All groups except one 
gave the course high scores. 

The data from California and Washington groups show the dramatically 
different results observed in different contexts. In California, teachers 
attended from several counties surrounding a metropolitan area. Prior to 
training, the teachers and administrators had been assigned to task forces 
to plan and carry out an innovation in several local schools. Although 
follow-up sessions, a part of RUPS training, were not held, the group met 
regularly for a few months to work on Implementation of this innovation. 
The Washington group was composed of inservice Teacher Corps trainees who 
had recently completed an Intensive two-week human relations class. The 
evaluation report notes, "The contrast between that experience (i.e., the human 
relations class) and the closely structured, tightly 'timed RUPS design 
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produced high cognitive dissonance and traloee mtstance." In Callfo^'nla, 
Where the materials were adapted to the group Interests* scores related 
to the acceptability of training met expectationsj the group of Washington 
Interns rated the program less favorably. For example, while 93 percent 
of the California group Indicated that they would strongly recommend the 
training to others, only 29 percent of the interns so Indicated. The evalu- 
ator concludes that "there was indeed a poor match between this training 
and the felt needs and concerns of the trainee group. . . (i.e., the Wash- 
ington .Interns), " 

Additional data Indicate that in a questionnaire judging comprehensioni 
87 . percent of the conwuni cation concept items and 67 percent of the problem- 
solving concept items were correctly answered by more than 75 percent of 
the participants." Tests of competence showed that "under a wide variety 
of field conditions, including high trainee resistance, the workshop was 
effective in helping trainees acquire problem-solving skills and" concepts 
of conmuni cation relevant to effective teamwork." 

However, an interesting finding of this study is that post-training 
scores bear no relation to use of training. That is, those who scored 
highest on the test do not tend to implement the program more frequently 
then those who scored lower. Instead, the extent of later implementation 
appears to be related to the circumstances of training. The overall con- 
clusion of the field-test findings is that those "who participate In the 
RUPS training as team members are most likely to make use of what the 
training offers" and that: 

In planning for or deciding whether or not 
to provide RUPS training for any group, atten- 
tion should be given to the experiences of po- 
tential participants just prior to the pro- 
posed :<UPS workshop .... It is not recom- 
mended that this training follow an unstruc- 
tured, T group type experience of any duration. 

The field tests did not attempt to evaluate the extent of implemen- 
tation of the process or the effect on schools and students', the Labora- 
tory will explore these Issues in future studies. 

In early 1971, tho Laboratory was ready to market RUPSj they had 
succeeded in developing an inexpensive, effective product that they hoped 
would be easy to disseminate. 



DIFFUSION 

Like RUPS Itself, the main element of the diffusion strategy had 
grown out of Charles Jung's experiences in Michigan long before the final 
product was ready to be marketed. In a paper presented at COPED In 1967, 
Jung emphasized the Importance of the trainer as a change agent. Today he 
says that a part of the plan for dissemination of RUPS was to distribute 
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the materials through a national network of regional trainers. However, 
It was recognized that one product alone would not provide sufficient In- 
centive or Income to support a formal network, and therefore until the 
product line had been expanded and the network formed, the Laboratory 
depended on an Informal network of experienced participants In addition 
to other methods of dissemination. ' 

As part of the dissemination strategy, participants are encouraged 
to train others in the RUPS ijrocessj once they have gone through the pro- 
gram, the developers contend, most participants are able to become trainers. 
Since most training Is handled through the Laboratory, experienced partici- 
pants, or the network of trainers. It Is unnecessary for the Laboratory to 
disseminate Its materials through a large publisher. Instead, materials 
are printed and distributed by a local printer. 

The Laboratory and the Printer 

At first, Laboratory staff were intrigued with the possibility of 
linking up with one of the major publishing houses in the nation and 
thereby gaining prestige and the stability of long-term product availabil- 
ity. However, most large publishers were not interested in distributing 
materials that had to be tied to training. The only large house which was 
Interested in publishing the product wanted to have exclusive control over 
all training experiences, and developers felt that the publisher would be 
operating the training at an exorbitant price. From the beginning the 
developers had attempted to creete an easily diff usable product, so the 
Laboratory declined the offer, since it would have negated the objective 
of diffusion at a reasonable price. 

Since a large, prestigious publisher could not be found under conditions 
acceptable to the Laboratory, the Laboratory located a small printer, Copy- 
Print Centers. The printer did not have sufficient capital to supply a 
steady inventory of the materials, and so the Laboratory supported the print- 
ing by purchasing the inventory. Proceeds from the sale of the materials 
were then available for the printing of additional materials. In November 
1972, the Laboratory decided to terminate the arrangement and.transfer the 
materials to a newly formed company that was more financially self-sufficient. 
The Laboratory had by this time located a printer. Commercial -Educational 
Distributing Services, that was willing to handle printing and distribution 
of RUPS even though the materials had not been copyrighted. Under a Novem- - 
ber 1972 contractual agreement, the company prints materials, receives orders, 
ships, warehouses components, reports sales, and pays use and commission 
fees. 

Both the director of dissemination at the Laboratory and the president 
of the printing company view their arrangement as a satisfactory one. The 
director notes that the service has been excellent. "They work very hard to 
meet our needs, to make sure we're satisfied," he says. He likes having the 
house in the same city. "We can get together and carefully nurture the re-- 
lationship to assure availability of the product," he explains. 




49 



Although the publls.ier Is entitled to advertise, promote, and sell 
the materials, the Laboratory and the network accept major responsibility 
for marketing the product. r ^ 

The Network of Regional Training Representatives 

The national network of 18 regional training representatives was 
developed to assist In the dissemination of RUPS and other teacher compe- 
tency programs. A contract between each representative and the publisher 
stipulates that the publisher will pay a co?!in1ss1on on sales. Although the 
Laboratory coordinates the network, provides referrals to the representa- 
tives, and advertises their availability, the network members are 
neither Laboratory employees nor consultants. The regional representatives 
were selected because they already had linkages with the state departments, 
colleges, and school districts in their area and because they had an 
understanding of the goals of the total program. 

f^«« D^twork representatives were not given specific training in dissemina- 
tion but were encouraged to use whatever strategies they thought were most 
feasible for meeting the demands of clients in their region. Thev were 
trained by the Laboratory in the systems each offers. Each has now trained 
from 10 to 35 others who assist with training in the geographical area. 

Trainers from the network are generally paid, under contract with 
the client, a consultant fee of $100 to $150 a day. They receive a com- 
mission from the publisher of $1.00 for each instructional packet sold. 
The Laboratory itself does not pay the trainers. 

Laboratory staff members also serve as trainers. In addition to the 
consultant fee, the client is required to pay travel expenses, Laboratory 
overhead, and per diem. 

The printer views the network as a reasonable alternative to a sales 
force. Salesmen, he contends, would not be able to make a living from this 
group of products. But he sees motivation as a problem. "The representa- 
tives have got to start acting like salesmen rather then professors," he 
says. He thinks that this may change as more of the representatives are 
trained in the Laboratory's various teacher-training systems. 

Laboratory staff members see the regional network of trainers as an 
effective component of their dissemination strategy. They note thattsaTes- 
men for a large publisher could probably do as good a job if they had the 
same background and training as the regional training representatives, but 
their assumption is that few do. The developer says that understanding of 
the system comes from, "a pretty good understanding of behavorlal sciences, 
learning dynamics, organizational development, and human growth and develop 
ment," He explains: 

A salesman who goes out just to make money ' 
from the distribution of a product will have 
a much different approach to a customer than 
an educator who wants to make sure that the 
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person understands what he ts buying, 
and what the product will and will 
not do. Our representatives may advise 
a client that tney need a product other 
than RUPS. I don^t think that a sales- 
man whose main product was RUPS would 
do that; we are interested In long- 
term change in education and not how 
much money can be made by it. 

Laboratory Dissemination Efforts 

The Laboratory's effort can be divided into two categories; the print 
mode and personal contact. Traditionally, more emphasis and resources have 
gone into mailings and advertising than into face-to-face contact. 

The Laboratory has developed different printed materials for different 
audiences. The materials range from a simple fact sheet containing one 
paragraph on RUPS, to more detailed announcement brochures and product 
summaries, to news releases, to a technical report. Emphasizing that the 
Laboratory does not depend on one technique, nor on one generalized message 
in its awareness effort* the director of dissemination explains that when 
contacting colleges and universities, for example, the Laboratory leans 
heavily on data and uses a personalized letter above the executive director' 
signature, 

The printer attributes the successful marketing of RUPS to the Labora- 
tory's large number of specialized mailing lists. For example. Laboratory 
membership is composed of 826 institutions Including school districts, 
professional associations, colleges and universities, and other agencies. 
The Laboratory also uses a mailing list frm a state system of higher edu- 
cation which includes names of deans and curriculum professors at selected 
colleges and universities throughout the nation. Selected commercially 
available lists are also used. Agency computers store the mailing list of 
Council on Educational Development and Research (CEDaR). Mailings such 
as the announcement of summer workshops are sent to nearly 8,000 colleges, 
universities, and school districts. 

RUPS has also been publicized in the CE DaR D&R Reports . According to 
figures compiled by the Laboratory, 450 RUPT¥rochures were sent out be- 
tween May 1972 and June 1973 in response to CEDaR request cards returned to 
the Laboratory. The only costs, aside from mailing, were membership fees 
in CEDaR. 

Advertising in an educational journal was viewed as rather expensive 
by the Laboratory; one ad In Grade Teacher cost $650 and elicited 759 re- 
quests for further information on RUPS. Because Laboratory staff did not 
view this effort as cost effective, magazine advertising has been discon- 
tinued. 
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Because educational Innovations are so often difficult to 1mplefnent» 

the director of dissemination feels that they are not presented best In 

print. "You need an opportunity for the educator to probe, to question* 

to wonder, and to interact with you," he says. He contends that because 

of the heavy work load of educators, the print mode, although relatively 

easy foV disseminators, is probably less effective than person-to-person 
contact and multi media presentations. 

The Laboratory is Involved in a number of personal contact awareness 
efforts. As part of the consortium, a cooperative effort among four re- 
search and development agencies, staff members attend national professional 
conventions and meetings. By cooperating, the director of dissemination 
says, the agencies can save money while adding to their professional 
visibility and showing that they can work together. Although he is un- 
comfortable with the cost effectiveness of the consortium notion ('If 
we look at how many sales resulted from attendance at these meetings, the 
record is dismal")* he points out that it is difficult to measure the 
good will and the credibility that result. "I am not ready to say that 
what we did as a Consortium in going to national conventions was a waste 
of resources," he emphasizes. 

The director says that the best way to acquaint potential users with 
a new product is to get them Involved with a piece of the product. He 
notes that in this way they not only get an understanding of what the pro- 
duct can do, but also feel more comfortable as a consequence. We have 
found that the most successful experiences come when we can sit down for 
half a day, for Instance, and talk about and explore the possible solutions 
for the unique concerns and needs of a group," he explains. 

Recently, Laboratory staff gave a presentation to supervisors and 
trustees at the request of a state board of education. The dissemination 
staff also helped organize a conference for a state association of class- 
room teachers. A new organization with little experience in conference 
planning, this association asked a Laboratory staff member to attend meet- 
ings and assist with the convention management. The Laboratory trained 
15 members of the organization to act as facilitators for a problem-solving 
presentation. While it is difficult to tracj: the effectiveness of this 
effort, one possible indication of success is that the Laboratory has been 
asked to assist with preparations for the second year. Such presentations, 
in the director's view, enable the Laboratory to reach a regional audience; 
through this contact, the Laboratory gains credibility and respect as a 
valuab'^i source of Information and assistance. 

Field-test sites, . part of the total dissemination strategy, are 
carefully selected to provide demonstrations and involve a new geograph- 
ical area or group in the Laboratory's teacher competencies program. Befor 
field testing some of the later products in the series, teachers must 
participate in a prerequisite RUPS workshop; field testing thus publicizes 
and earlier product. 
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SALES FIGURES 



The director of dissemination says he feels that RUPS has a respectable 
sales record, but adds that It's too early to measure Its effectiveness. 
"The strategy Is not for short-term, spotty effectiveness*. It calls for 
long-term Institutional changes," he emphasizes. Noting that there are 
ways other than sales to measure success, the director points to Increased 
use of RUPS by many groups outside the educational conwunlty. Too, RUPS 
has been translated Into German and Portuguese} a Mexican -American version 
has also been produced. No sales figures are available for these adapta- 
tions and translations; 

According to the Laboratory's latest information 1,113 leader's manuals 
and 4.049 participant packets had been sold commercially between March 1971 
and late-1973. Records indicate that 4,481 teachers and administrators were 
trained between 1969 and August 1972. (It should be pointed out that reporting 
methods necessitated comparison of sales figures through late 1973 to training 
figures through August 1972.) The number of people trained represents less 
than one percent of all teacheri> and administrators in the United States In 
1972. 

Because materials are so readily duplicated, "developers contend that 
sales figures do not accurately reflect use of the product. Since the 
whole package has some components that have not been copyrighted, teachers 
can reproduce materials with a relatively free conscience. Therefore, sales 
figures for participant materials may not reflect the actual number of 
trainees. 

Another factor which makes detailed evalualtion difficult is that those 
who have participated in RUPS training may become trainers themselves. 
Whereas records are kept of those who participate in training at selected 
colleges, universities, and school districts, and those who are trained by 
a national representative, the Laboratory keeps no roster of people who take 
the course through other avenues. 

The Laboratory's dissemination effort relies heavily on the multiplier 
effect, that is, on an experienced participant training others. Since the 
Laboratory has no records of the effectiveness of the multiplier effect, 
our staff attempted to Informally assess its success. (It should be em- 
phasized here that our figures do not represent a statistically valid sample; 
they are only an attempt to estimate the number of RUPS trainees since 
official documentation is unavailable.) 

If the multiplier effect were extremely active, it would serve as a 
very effective means of dissemination. If half of the 4,481 participants 
had trained 12 people, and if half of these trainees trained 12 more, the 
materials would have reached more than seven percent of the total audience 
of U.S. teachers and administrators. However, a number of factors may 
mitigate against a "chain letter" system of dissemination. One may question 
whether teachers who have completed a workshop feel capable or have the time 
to offer the training themselves. Another factor 1s whether trainers 
encourage participants to conduct training. Staff members from this project 
contacted graduates of two classes in order to elicit some responses to 
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these questions and to assess the 'impact of the multiplier effect. 

In August of 1972i twelve trainees participated In RUPS training under 
auspices of an association of school administrators. AH participants were 
in top-level administrative positions and were obligated, as a condition of 
training, to teach RUPS to others once they had completed the course. Four 
of the seven trainees contacted had trained a total of 125 additional parti- 
cipants; of the other three, one had organized workshops that other trainers 
had taught, one had taught parts of the course, and one felt that the course 
"hindered creative thinking" and chose not to offer workshops. A retraining 
rate of over 50 percent Is certainly Impressive and If true for other groups 
would indicate that RUPS had indeed captured a large share of the market. 

Our staff also contacted 13 of the 14 graduates of a 1973 RUPS summer 
workshop held at a state university. Participants included administrators, 
teachers, and students. None of the 13 had offered the training to Others; 
one university teaching assistant said that he might offer the training in 
the spring. Most respondents said that they did not feel qualified to offer 
RUPS and that they had not been encouraged to do so. 

Host teachers, at least in the group contacted, are reluctant to offer 
training since they feel that they do not have the necessary skills or com- 
mitment to training. This limited sample suggests that administrators who 
are more used to offering workshops and who, in addition, are required to 
offer training as a condition of participation might be more likely to train 
others. 

If we combine the figures from the two workshops, four out of 20 par- 
ticipants, or 20 percent, have offered training. Each trainer 1n the first 
group surveyed trained an average of 31 people during the 16-month period 
from August 1972 to December 1973. The Laboratory reports that 4,481 
teachers and administrators were trained between 1969 and July 1972. Since 
the materials were cwnnercially available only after March 1971, most of 
the teachers and administrators were trained between March 1971 and July 
1972, also a 16-month period. Let us assume that 20 percent of the 4,481 
participants trained up to July 1972 trained 31 people. We will also assume 
that there was enough time for another 20 percent of "secondjircund" trainees 
to train 15 people each. If this were true, a total of 115,582 people, or 
four percent of all teachers and administrators in the United States in 1972, 
would have been trained. Since the individual shares of instructional 
materials' sales for the 10 leading firms range from 3.5 percent to 7.4 per- 
cent, RUPS seems to have a respectable training record. 



DISCUSSION 

The Product 

Mssemlnators have discovered that users are attracted to RUPS because 
it Is one way of acquiring needed skills in a relatively quick and inex- 
pensive iiianner when compared to many other teacher training programs. Be- 
cause explicit instructions are supposed to make it possible for most graduates 
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of RUPS to replicate training, school district administrators can train a 
few master teachers who train others, rather than hiring an expensive con- 
sultant to work with all teachers In the district. If the program 1s pre- 
sented In sumner workshops using district teachers or administrators as 
trainers, the only costs are for the participant materials. 

As evaluative studies tentatively Indicate, we found that those parti- 
cipants who had gone through training with co-workers were most enthusias- 
tic about RUPS. Many graduates emphasized that the training had given them 
new insights for dealing with people. Most trainees whom our staff contacted 
were more enthusiastic about the team-work skills than problem solving. 
Some even said that other problem-solving models are bettev and less com- 
plex. 

Many elements of this package were farailiar to the edrcational commun- 
ity before the course was disseminated commercially. Workshops conducted 
by the first researchers and developers of the system Introduced partici- 
pants to many elements that were later Incorporated into RUPS. The dissemi- 
nators say that educators who are familiar with one component are inclined 
to accept the total package because they know that one element is successful. 

Not everyone is intensely enthusiastic about RUPS. During spring 
1972, the Laboratory distributed a brochure to advertise local workshops. 
Nine of the 12 summer extension programs scheduled at colleges and univer- 
sities were not held because not enough people signed up for the courses. 
One university employee said that she thought people were not interested 
in the course because they doubted that 1t would teach them anything new. 
Struggling for an explanation of the low number of inquiries about RUPS, 
an Instructor at another college says that perhaps the name is formidable; 
"research" alone, he notes, may be enough to discourage some people. He 
adds that when teachers take time to read the description or talk to people 
about the program, they are more apt to be Interested. One disseminator 
notes that the materials are not "intrinsically exciting." 

The Laboratory dissemination director says that some potential users, 
especially at colleges and universities, object to the tight structure 
of the program. Some administrators with whom we talk said that the 
training was too long and too highly organized. One remarked, "The program 
is too formalized; it hinders creative thinking." Most teachers, on the 
other hand, said that they liked the structure. One said, "I'm an organized 
person, I like a structured program." Another noted, "I tend to answer 
questions intuitively; this program helps me organize my thinking so that 
I can explain my view of the problem to others." 

Unlike the developers, some administrators feel that the package is 
costly in relation to what it will accomplish. Prospective buyers do not 
generally consider the materials themselves particularly expensive, but 
some view consultant fees and use of substitute teachers as costly. (This 
opposition can be overcome by offering the course through a university 
sumner school program.) Others find scheduling a problem; adjustments can 
be made, but it is best, the developers say, if it is offered on five 
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'Consecutive days with provision made for the two follow-up sessions which 
can be conducted without the trainer. 

Testing 

The testing of RUPS differed from that of marty other projects covered 
in this series of reports. Since RUPS was developed over a long time span, 
many of the ideas were Informally tested as the system developed. In the 
formal field tests the Laboratory attempted to avoid an idealized situation 
where they could choose an audience. Participants contacted the Laboratory 
and covered the expenses for materials and training. This situation per*- 
mitted a more realistic appraisal of how the materials would fare in the 
commercial marketplace than the developers could have attained if they had 
handplcked the participants and offered free materials. 

Dissemination 

In keeping with the project's philosophy of offering inexpensive train- 
ing, the developers chose not to disseminate their product through a large, 
commercial publisher. The Laboratory staff members point to arrangements 
with the printer and with the representatives as positive factors in the 
dissemination of RUPS. The director of dissemination says that the package 
design was better handled by a printer rather than a large publisher. The 
arrangement has been a satisfactory one, but he cautions others that one 
runs the risk of a small house experiencing insufficient financial resources 
or being unable to respond quickly to unanticipated large orders. He suggests 
that a thorough financial analysis of any company be conducted before a 
contract is signed. 

Opinion at the Laboratory holds that members of the network of repre- 
sentatives are more able than commercial salesmen to recognize the realities 
and problems of teacher training, yet the system has its problems, too. A 
representative and a Laboratory staff member both mentioned that there was 
little opportunity for all the representatives to meet and discuss strategies, 
problems, and successful methods. Calling all the representatives together 
for one five-day training session would cost approximately $19,000. The 
printer feels that training is the Laboratory's responsibility; the Laboratory 
staff say they do not have the resources for such a session, and they hope 
to share training costs with the printers of RUPS and of other teacher 
training products. The Laboratory's involvement in the training experience 
seems quite important to the network. A developer points out that the 
network probably could not sustain itself in most states without Laboratory 
assistance. One of the representatives mentions that he relies to a great 
extent on the Laboratory dissemination strategies and training in the systems. 

After the" initial training experience, RUPS dissemination depends 
heavily on the multiplier effect. The Laboratory therefore loses a great 
deal of control over the way the materials are being used. One group of 
trainers we contacted said they had completed a revision of the materials 
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and will no longer offer the 30-hour course. Th^i reluctance of many ' 
trainees to conduct training has been discussed above. 

R & D and Sale s 

: One regional representative notes that an important selling point Is 
that the training Is based on educational research. However, none of the 
graduates contacted by our staff had seen evaluation data before taking 
the^course. One> who learned of the evaluations after he had completed 
training, was critical, of the research because there was no attempt to 
evaluate the program's Influence on children. 

Cost Effectiveness 

During the development of the product the Laboratory accumulated 
Its costs as prescribed In its contract with USOE. The accounting pre- 
scribed did not provide for the determination of costs for each of the 
products being developed under the contract. Therefore, developmental 
costs cannot be determined for the RUPS system. 

The director of dissemination estimates that 30 percent of dissemi- 
nation money has been used for personal contact, while the majority, 70 
percent, has been used for other means of dissemination, mostly for 
printed and sample materials. He thinks that this proportion Is grad- 
ually changing, as it becomes more apparent that face-to-face contact 
is necessary for selling educational Innovations. 

The 30-70 percent ratio does not reflect training expenses, since 
trainers are paid directly by the client and through commissions from the 
printer. The regional network is viewed as cost effective by Laboratory 
staff members. 



Implementation 

Without a trainer, developers contend, implementation of RUPS Is 
Impossible. In order to help speed dissemination and Implementation, the 
developers have set up a national network of representatives. Through the 
multiplier effect they expect that many participants will train others and 
will become change agents in their schools. 

Few incentives for continued implefflantation seem to be provided by the 
developer. Late in the development cycle, RUPS added two "back-home" work- 
shops to the package. These workshops, if held, would help users with pro- 
blems they may have had In implementing the innovation and would provide 
a stimulus for continued use, at least for a 12-week period. No participant 
whom we contacted had attended a follow-up workshop. 
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PRODUCT SUHt^RY 



Pvoduot namet Parent/Child Toy-Lending Library 

Developep: Far West Laboratory for Educational Research and Development, 
San Francisco, California 

Di6tHbutor>.' Materials distributed by General Learning Corporation, Morris- 
town, New Jersey. Training for teachers/librarians available through 
consultants trained by the developer. 

DeaoHption: The Toy-Lending Library is a training program for parents 
of three-and four-year olds. It attempts to encouraga parents to help 
their children learn through enjoyable, shared experiences, so that the 
parents will feel more self-confident as educators, participate more 
actively in their children's education, and respect their children's 
abilities. Through the program, their children learn concepts and pro- 
blem-solving and communication skills. 

Parents meet for two hours each week during the eight-week course. 
At each meeting a new toy Is Introduced and the parents find out, 
through filmstrips, cassettes, demonstration, and role playing, how 
their children can learn frCm the toy. There are eight basic toys for 
use during the course and eight "leaner" toys for later use. Parents 
borrow these toys and also other toys, children's books, games, and 
records, as one borrows books from a library. 

A teacher/librarian goes through three days of training in the princi- 
ples and methods of the program and receives a Librarian Manual . Other 
materials are toys, eight filmstrips and cassettes that accompany them, 
two parent manuals, and a 20-m1nute color film. 

Tavget market: Although target users are parents and their three- and 
four-year-old children, the target buyers are organizations. Schools, 
daycare centers, public libraries, churches, industrial firms, and 
unit'ns are among the potential purchasers. 

Cost: The breakdown of the basic cost is: 



*One of these items should be provided for each parent. 

Thus, the start-up cost for a group of 20 parents is $1,852.00, or $93 
per parent, not including the librarian's salary. The developers 



*Set of 8 basic toys 
Set of 8 filmstrips and 
cassettes 
Librarian Manual 

*Parent Guide #1 

*Parent Guide #2 
Film 

Set of leaner toys 



$ 75.00 



100.00 
2.10 
1.25 
1.25 

200.00 
75.00 
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estimate a first-year tptal cost of about $100 per parent, based on a 
librarian's salary of $S,000 for the academic year (doing four hours of 
teaching each week), and assuming that 120 parents can be reached In an 
academic yea** (with two larallel classes of 20 parents each in three 
eight-week periods). 

Evaluation: Three cycles of formative evaluation were conducted at five 
sites. Evaluation covered children's Interest In the toys, children's 
achievement, the course and its power to attract participants, and con- 
tinued use of the library. The toys were evaluated by parent reports 
on the number of times children had shown Interest in them; the toys in 
which 20 percent of the children lost Interest were rejected or revised. 
Parents' self-reporting provided the information on the course; responses 
to open-ended questions about the experience were examined for congruence 
with the developers' objectives, and it was found that in the various 
subgroups between 53 and 100 percent of responses were related to objec- 
tives. Children's achievement was evaluated by pre- and posttesting of 
experimental groups; gains were significant on most subtests covering 
the concepts that were related to the program. Attendance at the course 
meetings did not fall off over time, and between one-third and one-half 
of parents continued using the library after the course ended. 

Evaluation of the training for teacher/librarians consisted of interviews 
with three groups of trainees six to 10 months after their training. 
It showed that 87 percent approved of the materials, 91 percent approved 
of the five-day training, and 99 percent of simple content questions were 
answered correctly. 



Current statue: Materials are available from the distributor; arrangements 
for training can be made through the developer. 

Innovative effects : The Toy-Lending Library program changes the relation- 
ship of parents to their children's learning. Developers intend that 
parents will gain respect for their children's learning potential while 
fostering children's growth in concepts and skills. More Importantly, 
developers hope to encourage parents to take an active part in the ed- 
ucation of their children. Since this is a preschool program, it does 
■ not directly change school practices, but developers contend that par- 
ents who are aware of how their children learn may play an Important 
role in changing schools. 

Synopsis of diffusion: This program seems to have considerable intrinsic 
appeal; professionals in the early childhood field and parents who heard 
of it through the mass media reacted with enthusiasm to its ideas. But 
installation of the program is a complex matter, requiring money and 
organization. The complexity of implementation also results from the 
fact that two agencies handle the program; a comrarcial distributor manu- 
factures and markets the toys and other materials, while the developer 
has set up mechanisms for oroviding training. 



To reach adopters outside the customary channels of educational market- 
ing is a difficult objective, and it is noteworthy that much of the dif- 
fusion effort has in fact been directed to schools. The Laboratory tried 
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to Involve state departments of education as linking agencies by pre- 
senting orientation workshops and providing materials that could be 
used for further awareness efforts in each state. Demonstration sites 
were helped to set up functioning Toy libraries. Both of these efforts 
were rather ambitious, involving 25 state agencies and 14 demonstrations. 
In retrospect, staff members think that more concerted programs with 
fewer linking agencies might have been more productive. 

Two tactics were used to help adopters overcome their Implementation 
problems. A paperbound book attempted to anticipate the problems- 
such as finding funds--and to suggest ways of solving them. Consultants 
were trained to give training to prospective librarians and to assist 
in implementation. 
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THE PRODUCT 



The Pafent/ChUd Toy-Lending Library was designed to help parents 
participate In their children's learnings the program shows parents of 
three-^ and four-year-old children how toys and games can be used for 
learning episodes, and It allows them to borrow toys as one borrows books 
from a library. In essence* the developers Intended to create a system 
to change parents' attitudes about their children's learning potential 
and about their own competency » The developers see this product as a 
parent training program and offer an eight-week course, which usually 
meets once a week for about two hours. Without this parent training ^ 
the product degenerates Into a package of toys, none or which is unique 
In Itself. 

At each weekly meeting, a new toy Is Introduced with a filmstrip and 
cassette that explain how to build learning episodes around the toy. 
Through demonstrations and role playing, the parents become familiar with 
ways of using the toy. Each session concludes with a discussion on some 
topic of general interest to parents, then the new toys are taken home 
for a week. After the course ends, parents are encouraged to use the 
library as a permanent source of new toys, games, books, and records. 

The program's goal is to help parents promote the intellectual de- 
velopment of children in a way that is likely to support the development 
of a healthy self-concept* Objectives include: 

1. Parents will feel that they are more competent in helping 
their children learn some Important skills and concepts. 

2. Parents will feel that they can Influence the decisions 
that affect the education of their children. 

3. Parents will feel that the child is capable of learning 
and can be successful . 

4. The child increases his competency au a result of the 
interaction with the parents.' 

The program is designed to foster children's growth in concepts and skills 
such as colors, shapes, problem solving, and verbal communication. 



Guide to Securing and Insta lling th e Parent/Child Toy-lending Library . 
Far West Laboratory for Educational Research and Development, Berkeley, 
California, 1972, C5. 
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The developers' goals for the Toy Library reflect the long-range 
objectives of the Far West Laboratory's Responsive Program, an educational 
system being developed for children aged three to nine. These objectives 
are "to help children develop a hoalthy self -concept as It relates to 
learning in the school and the homeland to develop their Intellectual 
ability."' A diversity of educational experiences Is sought by the Re- 
sponsive Program, which rests on the assumptions tiat much learning takes 
place In the home, that many alternative arrangements must be made for 
scheduling formal education, and that the educational program must be 
closely tied to the child's culture and background. Tne responsive en- 
vironment leaves a great deal of autonomy to the child: adult-Initiated 
talk should take second place to child-Initiated talk, and the child can 
choose not to participate In group activities (as long as he does riot 
disturb the group). His activities should be autotelic, that Is, they 
should not depend upon extrinsic rewards or punishments, and they should 
help him develop useful skills, concepts, or attitudes. 

The Toy Library was conceptualized as a way to help parents create a 
responsive environment for learning In the home. Its principles are those 
of the Responsive Program as a whole: 

Free exploration ; The child Is free to explore any toy and 
to change the rules of any game he may be playing with his 
parent. 

Self-pacing ; The child Is free to work at his chosen speed 
and to stop work when the game or toy no longer Interests him. 

Self-correction ; The toys are so constructed that the child 
can immediately find out the results of his explorations, either 
from the toy Itself or from the parent. 

Discovery learning; The child Is given time to discover things 
for himself-- the parent helps the child to think through a 
problem rather than giving him the correct answer. 

Self -reward; The learning activities ara satisfying to the 
child, and he does not play the game because the parent will 
reward him, or punish him for not playing. The child learns 
because he wants to. 

The principal developer of the Responsive Program saw the Toy Library 
as a way of enhancing parents' Involvement with their children's education. 
One staff member states that the developer: 



"^ A Guide to Securing and Installing the Parent/Child Toy-Lending Library . 
Far West Laboratory for Educational Research and Development, Berkeley, 
, California, 1972, B3. 
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, • .was probably one of the first to co^ne out with 
the notion that parents are teachers too, and that 
parents could do some of the same things in their 
homes that were being done In the Headstart, day- 
care» and private nursery schools. The program was 
to pull together some positive Interaction between 
parent and child. This Is not to say that parents 
are not positively Interacting with their children 
already, but that they could be trained to do some 
skin development and concept development, and In 
so doing, know more about the child's educational 
ability and the way he learns and his whole mode of 
Interacting. 

As parents learned to be more active participants In their children's 
learning, It was thought that they would assert themselves more strongly 
In school decision making. The developer points out, ''We hoped that one 
of the functions that the training would serve would be to give the parent 
more control over the educational system—how to make it more responsive 
to their needs—especially the minority parent*" 

The program was designed to fill a need for familie? above the 
Headstart Income level but not affluent enough to afford nursery school 
tuition. The developers estimated that three-fifths of the parents in 
the country fit this description* But, because of the training component, 
one family cannot act alone to purchase "the product." However, any one 
of a variety of organizations can set up a Toy Library, which requires 
a course leader, a room for the weekly sessions, some audiovisual equip- 
ment, and storage space. Schools, daycare centers, public libraries, 
churches, industries, and unions are among the target buyers. If no 
already-organizaed group In a community wants to take on the program, 
a group of parents can incorporate as a nonprofit association and begin 
to operate a Toy Library. 

To establish a library, an agency must: 1) select a meeting place; 
2) select a course leader; 3) find Interested parents; 4) purchase the 
materials; and 5) obtain training for the Toy Librarian. The meeting place 
can be in a school building, a vacant store, a daycare center, a mobile 
van— as long aj? the space is available every week and there Is room for 
storage. The course leader should be a community member with whom parents 
will feel comfortable. This person participates in a three-day training 
session designed to familiarize him or her with the concepts behind the 
program, the use of the toys, ways of communicating with parents, and the 
procedures for managing the course and the library. 

A Laboratory staff member explains that the librarian's interpersonal 
skills are crucial to the program's success. "You can't just send a letter 
out and expect to bring parents in," he says; "you have to make individual 
contact with parents and generate a nucleus group, that then becomes the 
disseminator. We discouraged teachers from bt.coming librarians because 
teacher types tend to teach, and this was not the! purpose. We encouraged 
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paraprofessionals, local community people, and parents to become librar- 
ians*" 

The Toy Library program is meant to supplement the customary proce- 
dures for early childhood education. It establishes new roles for parents 
(the users), for organizations (the purchasers), and for the course lead- 
ers (the facilitators). Furthermore, the developers contend that the 
physical product—the toys and other materials--is meaningless without - 
the training program, which requires planning and money to set up • Clearly, 
this is a complex product. 

DEVELOPMENT 

During the three-year period of development, from 1969 to 1S72, the 
Toy Library seems to have undergone little fundamental change* (However, 
because of marketing difficulties and his own changing ideas, the developer 
later designed a new version, including a core set of individually pack- 
aged toys and instructions for parents and their three- to nine-year-old 
children.) During field testing some aspects of the program were modified, 
but its essential aims and methods, which grew out of the Laboratory's con- 
ception of a total system for responsive early childhood education, re- 
mained intact- 

Because it is one of the basic assumptions of the Responsive Program 
that the family plays a primary role in education, the developers set out 
to devise a way of helping parents to be teachers, "There was no research 
evidence to indicate that kids need a classroom setting," a staff member 
explains, "but they did need the early learning experience." The target 
users were the estimated three-fifths of parents with incomes between the 
Headstart and nursery school levels. No initial marketing studies were 
conducted because the developers perceived their product to be unique and 
thus felt there would be no meaningful baseline data. 

Design of the program began with the premise that it should be inex- 
pensive, requiring neither professional operators nor extensive space. 

Over the three years of development, which was funded by th6 Carnegie 
Corporation with about $500,000, there were three cycles of field testing. 
The preliminary tests were carried out in two Northern California cormiuni- 
ties, Berkeley and East Palo Alto; the main field testing was done In two 
Utah school districts; the last stage was an operational test in Oakland, 
California. Program evaluation had five areas of focus: children's 
interest in the toys, the course Itself, children's achievement, the pull- 
ing power of the course, and continued use of the library. 

The toys were evaluated by means of parent reporting: each parent 
counted the nuntier of times the child played with each toy, after being 
asked if he wanted to and when he was not asked, and the parent reported 
instances when the child lost interest In the toy before the end of the 
week or before he could play without mistakes. The toys in which at least 
20 percent of the childt^n lost interest were rejected or revised. Of 
nine original toys, four were accepted, three revised and retained, and 
two rejected. 
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To gather data on the course, the evaluators decided to use parents' 
self-reporting because they could not devise an unobtrusive, nondlstort- 
Ing way to observe parent/child Interactions. A set of open-ended ques- 
tions Invited general responses to the program, which were then examined 
for their congruence with the course objectives. Of 165 responses, 15 
percent were classified as unrelated to the objectives, nine percent 
dealt with the toys and were classified as unrelated, and 75 percent 
were classified as related. Most related responses (53 percent) expressed 
a feeling that parents could help their children learn; 37 percent Indicated 
a feeling that the children were capable or could be successful i 10 percent 
were too general to classify. No responses Indicated a feeling that 
parents could affect educational decision making. 

Although the developers do not claim that within eight weeks there 
can be great changes In children's abilities or self-concept, they did 
test for cognitive gains. Children's achievement was measured by pre- 
and posttesting of experimental groups with 13 subtests, 11 of them re- 
lated to the concepts to be learned with toys from the program. Of the 
11 relevant subtests, the children made significant gains on nine and 
showed no significant change on two {on which pretest scores had been 
high). There were no significant changes on the irrelevant subtests. 

The pulling power of the course exceeded the objective that 50 percent 
of enrolled parents should complete It: almost none dropped out. Continued 
use of the library was observed for between one-third and one-half of 
parents over a period of a year. 

Evaluation was also conducted on the training provided for teacher/ 
libraria f'-^. Trainees were Interviewed six to ten months after completing 
the workshop and were asked for their perceptions of its usefulness. Eighty- 
seven percent approved of the materials, and 91 percent approi/ed of the 
training. Simple content questions Included in this interview elicited a 
99 percent rate of correct responses. 



DIFFUSION 

After development had been completed, the Laboratory was confronted 
with the problem of disseminating a program that tries to reach a new 
educational territory --the home. A producer/distributor was found for 
the toys and other materials, but the heart of the program, the parent 
training, could not be packaged and sold so readily. A federal grant sup- 
ported a three-pronged effort to bring about Implementations: state de- 
partments of education wero supposed to foster awareness of the program; 
demonstration sites would provide visible evidence of its methods and suc- 
cess; a network of trained consultants would be available to help set up 
Toy Libraries all over the country. This strategy was carried out, but 
the resulting diffusion of the program has not lived up to the Laboratory's 
hopes . 
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Because of the developer's reputation in the early childhood educa- 
tion field, a groundswell of professional Interest In the Toy Library be- 
gan during Its development. The Ideas behind the program gained exposure 
through professional journals and conferences, and the Responsive Model 
was chosen by the Office of Child Development as one of the "planned vari- 
ations" for Follow Through programs. Informally the Joy Library became 
known through the communication channels of Headstart and Follow Through* 

Ironically, one of the first diffusion problems stemrned from too much 
media publicity too soon: an unsolicited New York Times article appeared 
on March 30, 1970 , and several journal and"Tocal news stories were picked 
up from this piece, but It was not until well Into 1972 that Interested 
people could purchase any part of the Toy Library. 

In April, 1970, the Laboratory Issued a Request for Proposals for 
producing and distributing the toys and course materials, but no firms 
responded. Eventually, General Learning Corporation (GLC) was persuaded 
to submit a bid, largely because of the company's previous experience In 
working with the developer. Through a contract signed In June, 1971, GLC 
agreed to produce the toys, printed manuals, and audiovisual materials. 
In the negotiations, GLC staff had asked If the Laboratory had done any 
marketing studies on the Toy Library. A Laboratory staff member recalls, 
"That question was always an underlying factor In the skepticism that GLC 
had They were bothered that only limited advertising had been done 
through professional journals, field tests, conventions, etc*" No hard 
marketing research had been conducted to show what type of market existed. 

Because GLC deals with the early childhood field, the developers as- 
sumed that this company could reach the target audience for the product. 
However, the company's usual channel of distribution Is sales visits to 
schools; it could not locate the large preschool market that the developers 
had hoped to tap. Displays that GLC set up at conferences on early child- 
hood education may have stimulated some interest, but even so, they were 
not seen by many of the diverse kinds of potential purchasers, ranging from 
churches to labor unions • The production of the toys themselves caused 
problems, too: it was expensive to make them in small runs, yet the 
company was unwilling to Invest in a large production effort because Its 
staff was unconvinced of the product's marketability. The dissemination 
strategies of the Laboratory and GLC have had fundamentally different 
objectives; while the developer wishes to ensure that adopters re- 
ceive personalized training, the distributor needs to reach the most 
profitable market. Hence, the toys are sold directly to users through 
a catalog; the manuals are packaged separately and often are not re- 
quested by the people who purchase the toys. 

To try to fulfill the original expectations for broad-scale adop- 
tion of the Toy Library, the Laboratory sought funding from the National 
Center for Educational Communications (NCEC), A $218,000 grant, received 
in spring, 1972, supported a program of diffusion activities with three 
major components. The strategy was built upon diffusion theory, which 
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points to a sequence of awareness, Intej^est, trial, and adoption on the 
part of users. The Laboratory would bring about awareness of and Interest 
In the Toy Library through the mass media and by enlisting the help of 
state departments of education, whose personnel would mount "secondary 
diffusion efforts" in their states. Once awareness and interest had been 
aroused, prospective users could gain understanding of the program by 
observing its successful operation at one of several demonstration sites. 
Then adoption would be facilitated by the existencef of a network of con- 
sultants able to help set up Toy Libraries. 

In an attempt to ease Implementation, the Laboratory has put together 
a paperbound book, A Guide to Securing and Installing the Parent/Child 
Toy-Lending Library" It describes the program thoroughly and provides 17 
pages of suggestions for outside sources of funding for the program, in- 
cluding federal agencies and private foundations. This section even in- 
cludes the Articles of Incorporation for a nonprofit association in case 
parents need to form one. 

As soon as the NCEC funding began, the Labor?tory held a workshop for 
ten prospective consultants so that implementation assistance would be 
immediately available to any Interested agency. (During development, it 
had been thought that the Laboratory would handle all training of librarians, 
but it was later decided that a nationwide network of consultants could 
provide more economical assistance.) 

The content of the training sessions for consultants Included: an 
Introduction of the Toy Library concepts i a showing of the film, "Learning 
and Growing and Learnlngi" and discussions of the film, of the principles 
and objectives of the program, and of the importance of self-concept in 
both children and adults. In addition, time was spent in role playing, 
playing with the toys and games, and discussing the participants' reactions 
to these experiences. Filmstrips were shown to illustrate different uses 
of the toys, with emphasis on the importance of the affective interactions 
between trainer and parent and between parent and child. The last part of 
the workshop was devoted to an explanation of the installation of the Toy 
Library. A manual describing that process was used in discussion. 

Much time was spent talking about the kind of language to be used with 
parents. The developers were convinced that the success of the program 
would depend upon the sensitivity of the person who would eventually be 
working with the parents, and that this person could not be an authority figure 
who communicated in a Judgmental way. Prospective consultants with 
an authoritarian or a behavioristic philosophy were thought to be unsulted 
to work with this particular program, and the Laboratory staff tried to 
screen them out. 

Early in the Laboratory's dissemination effort, state education agencies 
were contacted to elicit their cooperation. A form letter from the Labora- 
tory Director was sent to all 50 chief state school officers, discussing 
the concepts and methodologies of the Toy Library and offering the services 
of a Laboratory staff member to present an orientation session to interested 
people at the state level. These letters did not produce a great deal of 
response. However, follow-up telephone calls were directed to specialists 
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In early childhood education, many of whom expressed Interest. In all, 
positive responses were obtained from 35 state agencies, 

At 25 of the 35 Interested statfi agencies, orientation sessions were 
conducted. Presentations reached as many as 700 people and as few as five, 
for an overall total of around 1 ,500. With a full daiy of discussions, fllmsi 
and workshops, Laboratory staff tried to convey overviews of the Laboratory 
In general and of the Toy Library In particular, then to demonstrate the' 
use of specific toys. Usually a representative from GLC set up a display 
at the orientation session and later visited Interested people In the state 
department. 

After the orientation session, materials were left at the state agen- 
cy, Including enough handout information for 1,000 people, a film, a des- 
criptive filmstrip and tape, a set of toys, and other program materials. 
State agency personnel were encouraged to disseminate information about 
the Toy Library. Responding to a Laboratory questionnaire, 10 agencies 
indicated that they had used their meetings as vehicles, nine had used 
newsletters, nine direct mail, five had held one- to three-day workshops, 
two had used local news media, and 18 word-of-mouth. Others had left 
materials on display or had exhibited them at teacher conferences, and 
some had contacted PTA^s and other organizations about the program. 

In the Utah State Department of Education, one staff member worked o 
half-time on Toy Library dissemi nation • Having been trained as a consultant, 
this person helped to set up Toy Libraries in the state, It should be pointed 
out, however, that the Laboratory has devoted a good deal of time to strength- 
ening its ties in Utah, in addition to the NCEC-supported contact. 

As the third major component of the Laboratory's diffusion plan, 14 
Toy Libraries were established as demonstration sites. The staffs at these 
sites were expected to generate publicity and provide high-visibility evi- 
dence of the program's effectiveness. It was anticipated that news of the 
demonstration sites would be spread by the sponsoring organizations: a Toy 
Library in a church, for example, would be described in church publications* 
Kor this reason, as well as to highlight the Toy Library's adaptability to 
different settings, a variety of agencies were chosen to host demonstra- 
tion sites. Schools, a comnunity center, a well-baby clinic, and a mobile 
van were among the diverse settings chosen. Laboratory-trained people helped 
to set up the sites and train the toy librarians. The Laboratory also fur- 
nished 20 sets of toys and materials to each site, thus defraying some of 
the expense for the sponsoring agencies. In addition to their dissemination 
work, toy librarians were asked to keep a brief diary on the parent training 
sessions so as to provide the developers with feedback on the effectiveness 
of the training materials. 

During the period of the NCEC grant, the Laboratory also sought publi- 
city for the Toy Library in the mass media. At demonstration sites there 
was local press coverage, including television and radio publicity. When a 
solicited article appeared in Woman's Day magazine in August, 1972> the Labora- 
tory received approximately 4>000 mail inquiries from parents > agencies, and 



ERIC 



educational Institutions. The parents were sent a brochure ("Parents and 
Children Learning Together") that explained the goals and objectives of 
the program in a highly readable format, heavily illustrated with line 
drawings and photographs of children playing with the toys. A cost sheet 
for the toys was included* and the parents were directed to GLC for purchase 
of toys, or back to the Laboratory if they indicated Interest In further 
Information or training. If they requested more specific information, they 
were given the name of a consultant In their region who had been trained 
by Laboratory staff as a trainer, and they were referred to a demonstra- 
tion site if it was within 100 miles of their home. Agencies and institu- 
tions received the same brochure and cost sheet, as well as the Toy Library 
Installation Guide, which gave them much more complete information. 

In mid-1973, the NCEC grant expired, and a proposal for further fund- 
ing was rejected. Now the Laboratory, with very little money to spend on 
dissemination, is looking for new ways to keep Toy Library diffusion efforts 
alive. Besides sending out informational brochures In response to corres- 
pondence, the staff is trying to provide orientation and training sessions 
on a self-supporting basis. In November, 1973, staff members traveled to 
the state of Washington to explain to 350 people how they could install the 
program. Thii session (sponsored by the state department of education, 
the Intermediate school districts, and the Parent-Teacher-Student Associa- 
tion) was attended by teachers, librarians, parents, and others. The Labora- 
tory Intends to gather data on the results of this presentation. It will 
conduct similar orientation programs for groups that pay the necessary trans- 
portation, per diem, and consulting fees. There will also be at least one 
training session each month at the Laboratory with a $150 registration fee 
for participants, and staff members will conduct training in the field for 
groups of at least five people if reimbursed for their expenses. 



SALES FIGURES 

Since the consultants are able to help Install Toy Libraries without 
assistance from the Laboratory, and since the materials can be purchased by 
people who are not implementing the program, Laboratory staff members are 
at a loss to estimate the number of Toy Libraries now functioning. The final 
report on the NCEC-sponsored dissemination project gives the numbers of Toy 
Libraries reported by state education agencies, colleges, and universi- 
ties as 60. Added to the 13 (out of 14) demonstration sites that have 
continued to operate, this would give a total of 73 Toy Libraries. However, 
several state department respondents did not give numbers, but stated, 
"ManyJ"; "I cannot be sure of the number as yet"; "One pilot"; "Others 
scheduled for fall"; or otherwise indicated general optimism. 

Have the Laboratory-trained consultants helped to set up many Toy 
Libraries? Those we contacted have not; they have conducted workshops but 
have not been asked for help by any agencies setting up programs. Still, 
they say that the people who have participated in the workshops could proba- 
bly establish Toy Libraries without any additional help. Thus they state 
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that they have no way of knowing how many Implementations have resulted 
from their efforts. 

The program was conceived of as a whole, complete with parent train- 
ing, and from the developers' viewpoint a partial adoption cannot be con- 
sidered a success. However, many purchasers of the materials have un- 
doubtedly picked up at least some of the basic principles. GLC figures 
for 1972 and the first half of 1973 reveal the sale of 1 .336 LibraHan 
Manuals and 461 sets of fllmstrlps, which are meant to be Integral to the 
parent training program. A larger number. of parent guides have been 
sold: 6,290 copies of Parent Guide I and 2,979 of Parent Guide It . These 
books describe the use of the toys as learning tooUand If parents fully 
enter into the attitude towards play that Is explained, they will use the 
Toy Library's principles. But It seems doubtful that the book alone can 
create the attltudlnal changes that are the goal of the training program. 

It appears unlikely that more th?in a few thousand parents have par- 
ticipated In Toy library courses. This number Is a negligible percentage 
of the target dudlence, since the stated target, three-fifths of the 
parents of three- and four-year-old children, numbers In the millions. 

DISCUSSION 

Conceptualization 

The notion of a Toy Library seems to have considerable Intrinsic appeal. 
For parents, the Idea of becoming Involved in the teaching and learning pro- 
cess Is exciting; according to a Laboratory staff member, "That was what 
motivated the parents to go out and sell our program"they were our best 
disseminators." Those who have worked In the diffusion effort for the Toy 
Library emphasize how few programs really Involve parents In their children's 
learning In a valuable way. 

One problem with potential users centers around philosophical orien- 
tation, since the Toy Library program Is firmly rooted In a "whole-child" 
outlook. Where educators or parents are looking for a behavl eristic, achieve- 
ment-oriented program, there is a philosophical conflict. 

Testing 

Developers originally acknowledged that recruitment and retention of parents 
might be a problem, but field-test results showed that parents' reactions to the 
program were positive. However, the developer seems to have paid less at- 
tention to possible resistance from others involved, such as the school 
(or other agency) administrators who must approve and cooperate with a 
Toy Library proaram. Personnel at the field-test sites were cooperative, 
but later experience has shown that the lack of such support can seriously 
handicap the program. / 
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The developers' emphasis on affective goals has led to some difficul- 
ties with educators who demand rigorous evaluation data, Since developeirs 
had no way to measure progress toward an objective like a healthy self- 
concept other than by accumulating subjective evidence from parentSi 
such educators occasionally are left unimpressed by the quality of Labora- 
tory's findings. 

Distribution 

The relationship between the Laboratory and GLC Is marked by a series 
of compromises, unmet and perhaps unjustified expectations on the part of 
both agencies, and most recently by more cordial and productive interactions 
through the personal efforts of staff members. GLC staff members were 
initially skeptical about the Toy Library's market potential; the Labora- 
tory staff members have resented the salesmen's Inability to provide "Im- 
plementation assistance. They have also been disappointed to find that 
GLC's usual customers are educators at the elementary level and not the 
people they wanted to reach with this preschool program. Because GLC 
needs to use profitable methods, the toys and other materials are adver- 
tised through a catalog, although the developers never Intended to 
sell the materials without training. The toys and manuals are not pack- 
aged together . 

Eventually the Laboratory and GLC began to coordinate their efforts. 
They agreed that if a Laboratory staff member presented an orientation 
session at a state department of education, GLC's regional sales manager 
would attend, male contact with interested persons, and later follow up 
these contacts. The two organizations discussed a Joint marketing study, 
but no federal money was forthcoming for such an effort, and the Idea 
was dropped. 

Linking Agencies 

When the Laboratory sent letters to all 50 chief state school officers, 
there was little response. A staff member says that these letters "Just got 
lost In the paper mill," especially since the recipients were probably wary 
of being asked to buy something. She says that follow-up telephone calls 
directed to specialists In early childhood education brought much better 
results. 

The effectiveness of the effort to involve state education agencies was 
sporadic. In some cases, one or two people In an agency did devote time to 
Toy Library dissemination if it coincided with their own priorities and 
organizational arrangements. Low-key methods were used In this "secondary 
diffusion" through state departments. Laboratory staff members now feel 
that they should have worked more intensively with the linking agencies. 
They also feel that a one-year dissemination project did not allow time for 
enough personal interaction. Some think that they should have contacted 
other kinds of agencies besides state departments of education, such as 
daycare organizations and public library associations. 
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Some Laboratory staff members question the value of the demonstra- 
tion sites. While the sites did set up Toy Libraries, there was little 
effort to engage in diffusion activities and little spread to other sites. 
One staff member suggests that instead of creating demonstration Toy Li* 
brariesi the Laboratory should have gone to sites where the program was 
already being installed. He feels that there would have been less need 
to help such sites with their own implementation > and the sites could 
have spent more time on dissemination efforts. 

Awareness of the Product 

On the whole, of course, the media publicity for the Toy Library 
was welcomed by the Laboratory, Still, one person notes that 1t created 
an image of the product as "a bunch of toy.^ that are fun for everybody," 
neglecting the course objectives of helping parents and children learn. 

Cost Effectiveness j 

Laboratory records indicate that a total of $263,900 was spent on 
Toy Library dissemination. Much of this money was received from NC EC, 
which awarded the Laboratory a $218*000 contract; the rest came from pro ^ 
gram budgets. The most expensivo component of the strateay was "Traininig 
Workshops," which accounted for an expenditure of $107,000, but staff 
members assert that training should have been their most effective tactic 
since it gave trainees the background to become disseminators. However, 
there is no evidence to show how many of the individuals trained at these 
sessions did in fact carry on dissemination efforts. The Far West Lab-^ 
oratory was unjble to supply continued support and encouragement for 
these activities because of limited financial resources. 

Evaluation of the diffusion program has been minimal, in part because 
many of those involved, at the Laboratory, GLC, state departments, and 
demonstration sites believe that the program is still gathering momentum. 
Because implementation of the Toy Library can be a slow process, they 
think that it would be unfair to judge its diffusion on the basis of cur- 
rent results, even if they knew what these results were. 

Implementation 

A fundamental problem of this program is that target adopters are 
likely to have difficulty going through the mechanics of installation. 
The Toy Library is not just Intended for school districts, yet it demands 
both organization and financing. Locating funds has been an impediment 
to some potential purchasers, such as groups of parents who run coopera- 
tive nursery schools. Other parents who are not already organized into 
such groups have the additional problem of joining forces with an agency 
or even putting one together. Although the Laboratory's manual, A Guide 
to Securing and Installing the Parent/Child Toy-Lending Library , attempts 
to address these problems, it seems questionable whether a book can do 
much to solve them. 
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training provided to consultants equips them to be trainers 
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training session for consultants centers around the 
installation process, including such matters as locating funds. 

Quality Assurance 

;.nH J5^^.5J^J®S" "° attempt to monitor implementation of the program. 
^??wL^^^^^'^'"'^^r exp ains that such monitoring would be inconslitent 
with the developers' philosophy. He explains, "The programs we know about 
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SIMULATION GAMES 




PRODUCT SUMMARY 



Ppoduot name: S1mula|tion games 

Developev: Academic Games Associates > Baltimore, Maryland 

Dietpibutop: Two games are distributed by Academic Gamts Associates, 
Six others are available from a commercial publisher, Bobbs Merrill. 

DeeoHption: Eight games are currently available for purchase. The games 
vary in complexity and design and can accommodate from two to twenty 
players in 1/2 hour to 6 hours pi ay 1 no time. In schools, the playing time 
is usually broken down into several 40-minute periods on consecutive 
days, although developers do not feel this is the optimal usage • Each 
game is packaged separately and contains a teacher's manual , which In- 
cludes playing Instructions, pictures of the game's parts, and guide- 
lines for conducting the post-game discussions. A few of the games 
have boards, but most rely on a packet of information for each player. 
All but one of the games have consumable parts, but teachers can mimeo- 
graph these items so that no repurchase is necessary. 

The games currently available include: Consumer (involving players 
in the problems and economics of installment buying); Democracy (a com* 
posite of eight different units that simulate the legislative process); 
Economic System (mine owners, manufacturers, workers, and farmers mar- 
kHy produce, and consume goods while trying to make a profit and main- 
tain a high standard of living); Ghetto (the pressures that the urban 
poor live with and the choices that face them as they attempt to Improve 
their life situation); Life Career (working with a profile cf a ficti- 
tious person, players allot his time and activities among the labor, 
education, and marriage markets); Generation Gap (simulates the rela- 
tionship between a parent and an adolescent in respect to five issues 
differentially important to both); Drug Debate (c> series of structured 
debates on the legalization or prohibition of eight substances); and 
Take (a learning game designed to teach young children how numbers 
behave) , 

Taraet market: Most users will be in the age range from 13 years to adult- 
nood. The target buyers are teachers, usually curriculum supervisors 
or chairmen of social studies or home economics departments. Seldom 
will a principal or a superintendent be involved In a sale, unless a 
large order for an entire school system is placed, which is a rare 
occurrence. 

Coet: The two games distributed by Academic Games Associates cost $5.95 
and $25, The six commercially distributed games range in price from 
$8 to $35. The average price is $21 , and the average number of parti- 
cipants playing a game is 15; therefore, the average cost per person 
(to the user) 1s $1 .40. If the game is reused, cost per person will 
obviously decrease. 




Eoaiudtioni Research evidence, available from the Center for Social Or- 
ganization of Schools, The Johns Hopkins University, indlcat'"'. that 
the games are as good as other teaching techniques. Performance on _ 
tests of factual information shows that the students learn as much 
as they do from more traditional methodologies. Based on semantic 
differentials and an Intellectual achievement responslbllllty scale, 
the researchers found gains In a Sense of control over specific spheres 
of activity. 

Cux'pent etatue: Because of Inadequate Income to support continued 1n- 
house game development projects, Academic Games Associates does not 
plan to undertake development of new games except on a contractual 
basis. It will complete games currently under development and will 
try to arrange to have these games marketed by a commercial publisher. 

imovative effeotdi Simulation games necessitate a change In the traditional 
relationship between student and teacher. Because the game rules deter- 
mine student activities, control shifts away from the teacher to the learn- 
ing materials. As supplementary activities, the games may serve a transi- 
tional function between a highly structured classroom and a more open 
atmosphere. Since games are' Inexpensive, they do not require a change 
in traditional spending patterns. 

Sunopsia of diffueion: Despite their simple appearance, the games have some 
handicaps as a marketable Item. They Introduce a new learning method 
to the classroom, altering the traditional authority relationship between 
teacher and students. They are also more complex than one might assumei 
the extensive printed Instructions are not easy reading, and teachers 
seem to benefit from spending a good deal of time preparing to use a game- 
for Instance, they may want to play It with friends beforehand. Optimally 
a game should be played over a period of several hours rather than being 
broken up Into 40-mlnute segments, and the developers recomnend^playing 
more than once; scheduling thus may be a problem. In other words. It 
cannot be assumed that either adoption or Implementation of this product 
will be a simple matter. 

Few of the salesmen who have handled the games are motivated to devote 
a great deal of effort to them. Besides being an Inexpensive Item, a 
game does not give rise to repeat sales since the consumable materials 
are easily duplicated. Six of the games have been marketed by three 
successive companies, all of which give considerable autonott\y to sales 
representatives. The developers themselves have distributed three other 
games, but with minimal marketing resources ,. few sales have resulted. 
They have developed and field tested three additional games, but decided 
against marketing these themselves; they are trying to Interest publish- 
ers in these games and have had little success. 

During development the games were extensively field tested and aroused 
much enthusiasm among test users. As a result, the developers have 
always believed that this product should enjoy a large volume of sales. 



82 



?2!f J !^ Representative did try to recauture something like the field- 
test situation so as to dispel teacher skeptlclstnj he held a number of 
workshops in which teachers learned to use the games. But this tactic 
was too expensive for him to continue, The simSlat in games 'ability 

tive purchasers seems to be an example of the way a developyallowS^^ 
Sf'tKarket! ''^^"'^''^^'"^ test subjects to distoj^ts peJJSption 
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THE PRODUCT 



BetweenJ962 and 1968, a team of social scientists at The Johns 
Hopkins University developed a series of teaching tools called simula- 
tion games. The series is based upon educational theories stressing 
the need for active student participation} It reflects the belief that 
the teacher's most effective role is to analyze and respond to students' 
needs, rather than to control thei»* performance. Simulation games 
were des gned to enable junior and senior high school students, usually 
in social studies classes, to experience autonomous, self-motivating, 
and self-regulating role playing in a miniature social system model. 

Because of the need for the student to engage in abstract think- 
ing and to apply that thinking in concrete situations, and because of 
the complexity of most of the social situations simulated (the legis- 
lative process, the economic system, ghetto living, career and life 
choices, parent-child relationships), the games are not appropriate for 
students below the seventh grade level. The games vary in complexity— 
some have complicated rules, scoring tables, and several forms and score 
sheets, while others have simpler rules and little printed matter— so 
that it is possible to modify a complex game by eliminating some aspects 
of the. mo4el, or to add features of the real world not already simulated 
to complicate the game, making it more challenging to older students 
and adults. 

Users uniformly agree that the games are stimulating teaching 
tools; the students like the games and are often surprised, upon re- 
flection, by the changes in their attitudes toward themselves or the 
system being studied. The games are not intended as substitutes for 
more conventional teaching methods; rather they are aids to prepare 
students to participate more actively in discussions and to make more 
meaningful associations between the unit of study and their own under- 
standing of it. The salesmen feel that the product gives the partici- 
pant a tremendous identification and emotional involvement with the 
role he is playing and that it stimulates class discussion—both per- 
sonal and academic. This is an extremely important selling point in 
the salesmen's estimation. 

The games may be used in a variety of ways to enhance a unit of 
study; they may be used at the beginning of a unit, introducing the 
student to major concepts or problems, or they may serve as a concluding 
activity, summarizing and consolidating important concepts. Because 
they are open-ended in design, they are extremely flexible in use. For 
example, in Democracy, urban or statewide issues can be substituted for 
the national issues given in the game. 

To use the games successfully, a teacher may have to undergo 
some attitudinal and behavioral changes. Because the rules are in the 
games themselves rather than being imposed by the teacher, and because 
the outcome of the game, not the teacher, decides the winner, control 
of the class shifts from the teacher to the learning materials---and 
ultimately to the students. Thus, teachers who are uncomfortable with 



unstructured, open-ended Interactions In their classrooms may resist using 
the games. 

As well as being unfamiliar as a teaching tool, the games are some- 
what complex to use. While a gifted teacher may soon see how to use the 
game advantageously, most teachers need some preparation. Developers «nd 
salespeople agree that user satisfaction Is directly related to the amount 
of time the teacher spends with the game prior to presenting It to stu- 
dents. The printed Instructions Included with each game are Intended to 
be comprehensive, and salesmen have reported that they are too lengthy. 

DEVELOPMENT 

In the first half of the 1960s, educational theories and Innovations 
were receiving much attention In government policy and In the media. . 
Simulation gaming was not a new Idea, but previously It had not been 
applied In the classroom. As early as 1898 Karl Groos, In a book en- 
titled The Play of Animals , stressed the Importance of play as a neces- 
sary part of the life cycle. During play, he noted, all animals Includ- 
ing man practice activities that they will have to cope with later In 
real life. In the 1920s Dewey wrote about play, stressing Its Impor- 
tance as an Integral part of the regular school curriculum. With Groos, 
he shared a belief that children should be allowed to practice role play- 
Ino and skills that they will need In adulthood. 

The decision to actually develop games to produce specific learning 
outcomes In classrooms came about In the 1960s after several research 
projects had been conducted on ganes for school use. In 1961 James Cole- 
man finished one such study of ten mldwestern high schools. Noting that 
sports and cheerleading were more highly valued than school subjects, 
he suogested the development of several academic games Which would be 
organized like Inter-scholastic athletics. In addition to sparking In- 
terest In academic subjects, Coleman and his colleagues believed the 
games would give students a sense of control over their own lives. This 
"belief in control of environment," Coleman contends. Is a major factor 
contributing to successful achievement In school. 

In 1962 Coleman and his associates at The John Hopkins University's 
Department of Social Relations received a three-year grant of $100,000 from 
the Carnegie Corpofatlon to begin game development; during the next six 
years the project received additional funding from Carnegie. In 1967 the 
U.S. Office of Education funded a segment of the project to conduct experi- 
mental research on the effects of games. In all, $900,000 was spent on the 
games, Including research and dissemination as well as development. At the 
apex of the project, the funding supported a staff of nine people. 

As academicians began to realize the usefulness of gaming as a teach- 
ing strategy, the media picked up the idea as newsworthy. Several tele- 
vision programs were devoted to gaming in the classroom; Newsweek . Time, 
the New York Times , and Life ran articles describing educational games; 



ERIC 



86 



educational journals such as Instructor . Media and Message , and Social Ed* 
ucation discussed the implications of simulation games. At no cost to the 
developers, a wide audience heard of their games as examples of this inno- 
vation. In this way, a large network of potential users became interested 
long before the developers had a game available for mass production. 

The publicity was invaluable in providing willing participants for 
the nuinerous field tests that have been conducted since 1962. In one in- 
stance, the game Democracy was field tested with ] 400 students at a 4-H 
convention. Most of the teachers who participated were very willing to 
experiment with the product, and this positive attitude facilitated the 
continual revisions that were made in all the games. Each game went through 
at least three revisions as a result of data accumulated in the tests, and, 
in many instances, a certain number of experimental versions were locally 
produced for distribution to teachers in return for extensive feedback. 

In the early field tests, the developers attempted to evaluate the 
games ac a teaching tool and to assess whether the simulations cohtribu- 
ted to academic achievement and affective growth. Later, the researchers 
conducted studies to determine whether the games produced measurable fac- 
tual learning, reduced school absenteeism in poorly motivated students, 
and enhanced particpants' sense of their own capabilities. An example 
of the research is the following: 



A growing body of theory and evidence supports the 
view tKat behavior in general and learning in parti- 
cular Is strongly affected by the individual's sense 
of 'co'itrol of destiny' . ..that is, the extent to which 
he believes that his destiny is controlled by himself 
rather than by luck or other arbitrary features of 
his environment. .. . Our hypothesis is. . .that absense 
of sense of control is more likely among those who in 
fact had less experience with 'Situations where they 
either could control the outcomes or could at least 
see how their own actions were related to the outcomes. 
If this 1s an accurate conception of the variable..., 
extended experience In, simulated environments might 
remedy the deficiency.' 

Did the games work? The results of an experiment to test the above hypo- 
thesis were published in 1967. Boocock, Schild, and Stoll , using semantic 
differential scales and an intellectual achievement responsibility scale, 
found that the games did not produce "sense of control of a global sort... 
though there does seem to be some development of a sense of control over 



Boocock, S.S., Schild, E.O., & Stoll, C. Simula tion Games and Control 
Beliefs. Final Report. The Center for the Study of Social Organization 
of Schools. Baltimore, Md.: The Johns Hopkins University, 1967, p. 102. 
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specific spheres of activity." Another experiment which 8oocock conducted 
In Berkeley, California in 1964 showed that the Life Career game did lead 
to growth in factual learning. She writes, "Players did better than their 
controls on listing items and on questions that required understanding of 
the general relationships between educational and other institutions." 

On a visceral level, the developers report that the sti:dents enjoy 
the games tremendously; their written feedback during field tests substan- 
tiates this claim. But researchers have been consistently plagued by an 
inability to evaluate the total effectiveness of a game. They say that 
the special advantages of teaching with simulation games are not likely 
to be completely revealed through objective tests of factual information. 
Learning is explained by a more complex set of variables, including ini- 
tial knowledge and background of the students, and the nature of the sub- 
ject matter, as well as teaching techniques. The statement now made by 
the developers, and backed by empirical data2, is that the games are as 
good as other teaching techniques; the students learn as much as they~3b 
from more traditional methodologies, and they are more motivated to learn 
from the games than from other modes. 



DIFFUSION 

Since the release of the games in 1966, the developers have been frus- 
trated by what they consider a disappointing sales record. They are con- 
vinced of their product's merits , and they point to the field tests as 
evidence that teachers share their excitement. However, two publishing 
companies have proved unable to generate as many sales as they had hoped 
for, and an association formed by the developers in an effort to try their 
own hand at diffusion has also met with little success. 

After field testing, when the games were presented to teachers unfami- 
liar with simulation concepts (and, perhaps, resistant to innovation), 
salesmen reported encountering much of the traditional skepticism toward 
new teaching tools. Thus, sales efforts were generally directed toward 
those teachers most receptive to innovation and most willing to take a few 
risks in their classrooms. To interest a larger group of adopters, it was 
felt, would have required more money than the publishers or developers 
could invest. 

Dissemination began on an optimistic note. The teachers who saw the 
media publicity for the games in the early 1960s and who volunteered for 
field testing were anxious to purchase and use games themselves. With 
pressures from teachers- to provide games, the developers signed a contract 
in 1966 with a small commercial company, Simulmatics. The developers had 
given some thought to producing the games themselves, but they soon realized 
that tneir lack of experience in marketing and their major Interest in 
development made it necessary for a commercia" company to handle dissemin- 
ation. The funding agency, Carnegie Corporation, was most supportive in 
the developers' efforts to locate a proper commercial distributor. 

^Numerous reports from the Center for Social Organi/iation of Schools at 
Johns Hopkins. 
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Th6 developers had been approached by a number of the larger educa- 
tional publishers, but they chose a smaller coinpany, thinking that In this 
way they could retain more control over the final product design and the 
company would devote more time to marketing the games. It was an unfor- 
tunate choice because Simulmatlcs proved to be too small"they didn't have 
the capital to invest in a large run of games initially, and, because the 
company was not experienced in producing games, the products were not up 
to the standards expected by the developers. Nevertheless, the developers 
stayed with this company for two years, until the company went bankrupt. 
Looking back, the developers complain that the company initiated very little 
marketing strategy and did not follow up on the numerous inquiries and re- 
quests that were received during the time of the contract. They felt that 
the company was unwilling to take a chance with the games, since they were 
such a new item. (It must be realized that these comments represent only 
the developers' point of view, since no information Is available from those 
employed by Simulmatlcs.) 

The time Is now late 1968 and the Carnegie money has run out*, the 
team decides to form a nonprofit corporation. Academic Games Associates 
(AGA), that will be subsidized from royalties they expect to receive from 
the games, augmented by income they expect to, earn through consul ting con- 
tracts. The monies will provide a source of funds for continued game de- 
velopment. Each designer holds the copyright on his or her own game, and 
each will contribute a major percentage of the royalties to the corpora- 
tion. Through a series of misadventures, the corporation was denied non- 
profit status by the state and thus became a corporation with privately 
held stock. When federal money was awarded to the Hopkins Games Program, 
which became a part of the newly-formed Center for Social Organization 
of Schools based at the university, the corporation remained separate and 
received none of the funding. The Hopkins Games Program's activities were 
research-oriented; the corporation's, development-oriented. 

By 1969, the developers had signed a new contract with a large edu- 
cational publisher. Western Publishing, which advanced $5,000 for each 
of the five games that it bought in the first year. Western Publishing 
was sophisticated In educational marketing, and its staff was enthusiastic 
about the product. Initially, two direct mailings advertised the games, 
several journal ads were run, demonstrations were held at conventions, 
and articles were fed to educational magazines. However, from 1969 until 
late 1973, Western relied upon 40 commissioned representatives In the field 
to market the games. 

The strategies that these people used naturally varied according to 
their perceptions of the market, their contacts, and their personalities. 
One representative held 30 to 40 workshops for teachers In the first two 
years that he sold the games. He felt that the games needed to be demon- 
strated to be sold, and he gambled on his time to generate those sales. 
He now feels that as a vehicle for selling, the workshops were not success- 
ful, because the number of sales he achieved was not conmensurate with the 
time expended. He needed a large order to achieve an adequate commission, 
and the large orders were not forthcoming. Another representative, who 
simply left leaner copies of the games with potential users, sold nearly 
as many by spending only one-fourth as much time. The men knew what their 
time was worth, and they would not spend a lot of time on a product that 
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would not sell. Neither of these salesmen felt that the games were a suc- 
cessful Item, although both were convinced that the product was potentially 
valuable to educators. 

In the developers' view, workshops are Important avenues to dissemin- 
ation, but there Is no way of knowing how many direct sales are generated 
from workshops held by developers, since Western Publishing does not keep 
records Indicating the source of sales. 

In late 1973 Western sold the games to the Bobbs Merrill Publishing 
Company. Bobbs Merrill had been looking for multimedia, elementary lan- 
guage arts materials which they purchased from Western i the games were 
Included as a part of the total sale. Although the games were neither In 
the subject area nor at the grade level this company Was Interested In, a 
representative from the company views them as "a fine product." The com- 
pany Intends to retain the same commissioned representatives who sold the 
games for Western Publishers. They have printed a brochure but have not 
had time to mount a sales campaign. Bobbs Merrill has never before been 
Involved In the sale of games; a company representative notes that they 
have not yet assessed the market, but he hopes that the rising Interest 
In career education and consumer affairs will attract a large number of 
social studies teachers and career Information specialists to at least two 
of the games , Life Career and Consumer . 

Since 1969, the developers have operated Academic Games Associates 
as a service and development company. Seven games were developed from the 
corporation's Income; three of these games are marketed by them; four more 
have recently been field tested. An eighth game was developed for a client 
under a one-year contract. Their primary dissemination tactic has been 
to place ads In a journal, now edited by their corporation. This Journal, 
Simulation and Games , Is a quarterly that reaches 1200-1500 people; It sells 
for $12 a year to Individuals and $20 to institutions. The Journal is In- 
terdisciplinary and publishes articles on theory, design, and research re- 
lated to simulations and games. From October 1968 through May 1973 the 
Journal was financed through the federal grant to the Johns Hopkins Games 
Program; it Is commercially published, and $32,000 was allocated to it for 
staff time in fiscal year 1972. On June 1, 1973 the Journal 's editorial 
offices moved to Academic Games Associates. The journal's audience con- 
sists of those Interested tn design and gaming techniques. Its readers 
may Include many secondary level teachers, but a sizeable portion are re- 
searchers. 

The developers also received one free ad In Simulation gaming news , 
in exchange for their mailing list. There was no money to run a direct 
mall campaign. The rest of the dissemination came about through word-of- 
mouth from people familiar with the commercially produced games, and through 
responses to inquiry letters (about 26 letters per week) generated by the 
earl ier articles in educational publications. 
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As of this writing, Academic Games Associates Is nearly bankrupt. 
The royalty checks from the commercial publisher pay the office rent and 
salaries for the president, the administrative assistant-treasurer, and 
the half-time secretary. One of the games ( Trade and Develop ) has sold 
out, and there Is no more money to rerun it. Because of Its precarious 
financial base, the corporation has decided to curtail development of 1n- 
house games. It does not plan to market the seven games It has developed 
since 1969; Instead, It Is trying to Interest a commercial publisher In 
producing and marketing these games, but to date It has had little success 
in this. In the near future, development of new games will be done only 
on a contractual basis. 



SALES FIGURES 

Developers have no records of the number of students who have 
played the games} It Is therefore Impossible to assess the Impact of the 
games on the target audience of students. Neither do the records Indicate 
who actual purchasers were. Me do know that teachers are not the only 
purchasers; many games have been bought by Individuals, and over 1,000 
Girl Scouts and 4-H Club members have used the games. But the largest 
audience for simulation games, according to the developers. Is social 
studies teachers. Because we know the audience Includes many different 
groups. If we compare the number of social studies teachers to total 
sales, our figures will Indicate that the disseminators have covered a 
larger share of the audience than they actually have. However, since 
other figures are unavailable, we are forced to compare sales to the 
total audience of social studies teachers for an indication of the 
success of the games. 

The U. S. Office of Education estimates that there were approximately 
122,766 high school social studies teachers in the United States in 
1970.3 Chart I shows sales by Western Pi^blishing from June 1970 to Decem- 
ber 1973 and sales Academic Games Associates from 1969 to December 1973 
figures are not available from Simulmatics, the first and now defunct com- 
pany that marketed the games. Therefore, our estimates are lower than 
they would be if a '^cord.of all sales were available. 



3 

Simon, Kenneth and W. Vance Grant. Digest of Educational Statistics. 
1970 Edition . Table 60, page 39 and Table 63, page 40. 
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TABLE 1 

SIMULATION GAME SALES BY THE COMMERCIAL DISTRIBUTOR, WESTERN 



GAME 

Consume)'' 
Democracy 
Economic System 
Generation Gap 
Ghetto 
Life Career 



NO. COPIES SOLD . 
6/70 • 4/72 5/72 - 12/73 



2,955 
5,796 
2,239 
3,625 
6,142 
2.630 



1,118 
2,203 
1,031 
1,208 
2,201 
1,528 



« OF SOCIAL 
STUDIES TEACHERS 



'4« 
7%] 



SALES. BY DEVELOPER'S OWN CORPORATION, ACADEMIC GAMES ASSOCIATES 

through 12/31/73 

Trade and Develop (from 9/69) 740 
Drug Debate (from 8/11/70) 202 
Take (from 11/16/70) 784 



M] 
.2%] 



The Directory of Educational Simulations. Learning Games and D idactic 
Units 1 1 sts 20 commerlcally available games that could be used in secondary 
social studies classes. Thus If every potential purchaser bought one 
game In 1969, the market share for each of the 20 games would have been 
five percent. Those games marketed by the commercial publisher have done 
quite well, since sales have averaged between three and seven percent, 
while those sold by the developer have captured only .5 percent and .2 
percent of the audience. A viable explanation for this discrepancy is 
that the developers were operating with a very small staff and no money 
for publicitv, while the commercial firm had 40 commissioned representa^ 
tives throughout the United States. 



DISCUSSION 



Design 



On the surface, it appears that simulation games would be easy to 
disseminate. The packaging is simpje, the product is inexpensive, and 
there appear to te few barriers to Moptloh and use. But gaming is a 
novel idea in edicationi implementation is more complex than it might 
appear Jkt first (Tance. The instructions themselves are' relatively 
complex. Extensive printed instructions are included with each game, 
and suggestions for post-game discussions provide a starting place 
for a teacher's own ideas. Although the developers claim the instructions 
were totally effective with the field-test users, the salesmen maintain 
that the instructions hindered sales because they were too complicated 
and lengthy. One salesman thinks that an audio cassette should be 
provided with each aame—one side for teacher Instruction, the other 
directed toward students. 



The complexity of the g«mes also gives rise to the suggestion from 
the developers that the students should play the game several times, 
since some students do not fully grasp the strategy of a simulation 
during the first play. In a school where teachers are not pressured to 
cover^a certain amount of information in a given time period, it may be 
possible to schedule several playing periods. Many teachers are not free 
to do this, however, and if they can only play the game once with each 
class, they may not think the game totally effective. 

Salesmen cite several other reasons for the difficulty in marketin" 
the gamesi most teachers are not responsive to unstructured learning ^ 
situations where the locus of control resides in the students, and if 
teachers are not philosophically in agreement with learning through simula- 
tions, there is not much one can ri-.) to convince themj the games and the in- 
structions are relatively complex, and there may be no way to simpiify them 
enough to appeal to a wider range of teachers without sacrificing the basic 
learning objectives. The games do not generate repeat sales, since teachers 
can copy consumable Items and userS of one game do not seem to request 
other games, and this hurts the salesmen. 

There are few physical barriers to adoption. Players need only 
enough space to confer and strateglze together; they do not need to sit 
around a large table in order to play the games. Noise sometimes becomes 
a minor problem; students can become quite boisterous during plav. and 
this may be disturbing to neighboring classrooms. 

The Developtnent Process 

The independence of the developers during the early stages seems to 
tlu^^nu 1 valuable. Several members of the staff mentioned that it was 
the hands-off" attitude of the private foundation that was most helpful 
during development; they say that they could not have done the develop- 
mental work under government grants with the usual demands for r;;(ten$lve 
reporting and rigid deadlines. Having the freedom to retest and revise 
the products continually for six years enabled them to produce nine mar- 
ketable games (and more than 20 other games that did not withstand the 
rigorous field testing). 

Field Testing 

Beginning in the early stages of the development process, the staff 
tested their games with teachers who were attracted to the simulation 
concept. Like many other developers, they assessed the merits of the 
product after the field-test participants had become familiar with the 
games both through workshops and class use. Since the developers had 
worked with those teachers who were open to innovation and who had had 
experience with the product, field-test results led them to believe that 
an extensive market existed for the games. However, when salesmen tried 
to sell the product, they encountered many teachers who doubted the merits 
of this new teaching tool. In other words, the developers had selected 
a biased field-test audience and discovered the limitations of their mar- 
ket only after the product was released. 



since field testing was conducted with teachers, who are also the 
purchasers of the games, the developers were not confronted with the dif- 
ficulties of other product developers who have to appeal to two separate 
audiences of users and buyers. 

R&D and Sales 

Does the product's research background matter to users? How concer- 
ned are teachers with the evaluation data? Not very. Salesmen for the 
commercial distributor report that very few of their purchasers--potent1al 
or actual--have requested the field-test Information, although It Is easily 
available and the salesmen mention It In thv^lr explanation of the product. 

When teachers do ask for evaluation findings, which happens Infre- 
quently, they tend to use them to convince a principal to buy a game that 
they want. Generally the research findings are disseminated to the grow- 
ing number of academicians interested in gaming as an educational tool. 

Relationships between Developers and Disseminators 

As mentioned earlier, the developers and the commercial distributors 
have disagreed about the audience appeal of the product and about effec- 
tive means of dissemination. The developers were convinced by the media 
and by their field-test respondents that a sizeable mv>rket existed. The 
publishers were unable to tap that market, If Inriecd It existed In the 
proportions assumed, to an extent that returned them s satisfactory profit. 

Developers maintain that they are not businessmen^ nor are they in- 
terested In making money, yet they are quick to condem'i;^'e salesmen's 
analyses. Salesnen say that academicians are hopelessly alve about what 
educators will buy and use,. and they comment that a dlsposUon toward re- 
search and documentation does not produce a usable product. 

The salesmen f.ay, bassd on lack of sales, that the games are not be- 
ing used; teachers may be pro:<d that they have a modern teaching tool ♦ 
but It's sitting on the shelf. If they were using it, there would be re-^ 
peat^sales due to their satisfaction with the product. Both grpupJ; aaree 
that iixSlmlilatlon game Is' not a simple teaching tool; neither caljS it 
unmarketable, but there 1s no agreement as to what Its complexity means 
to users! Salesmen say that teachers are Intimidated by the pro|uct; de- 
velopersVlisagree, based upon their experience. When the salesman can 
convince |:he teacher to devote the time to, reading the instructions or 
to pl^ylnl the game, then the product can almost sell Itself, But this 
is a formidable obstacle for a salesman to overcome. And Is it worth his 
time? . Financially, the Incentives for selling simulation games are very 
small . It is a low-cost product that generates few repeat sales, since 
teachers can reuse the product many times and since the consumable Items 
can be easily copied. 



Cost Effectiveness 



Neither the developers nor the distributors have broken dlssenilna- 
tion costs into components. Early dissemination efforts on the developers 
part were supported by a grant from the Carnegie Corporation. The money 
was used for staff salaries and travel to workshops and field-test sitas. 
The workshops were generally held in schools, churches, faculty lounges, 
and other rent-free spaces. FieU' tests were held during school hours 
and incurred no costs to the project. Later efforts were financed from 
the royalties and income earned by the corporation through long-term and 
short-tenn consulting contracts. 

With the private funding for workshops, the developers did not have 
to validate the cost effectiveness of their efforts. Salesmen, on the 
other hand, were forced to look critically at the time expended p6r sale. 
One salesman who held 30 to 40 workshops for teachers in two years now 
feels that the number of sales that resulted was not adequate to Justify 
all the time expended. Another salesman sold nearly as many by devotinij 
only one-fourth as much time and simply loaning copies of the games to " 
potential buyers. 



Training 

Developers think that training Is advantageous but not necessary 
for Implementation of the games. Workshops in which the teachers actually 
play the game are thought to be the best training, but since workshops 
are not always feasible, the developers have attempted to make the teach- 
er's manual so explicit and comprehensive that any teacher can explain 
the game upon reading the Instructions. The developers feel, on. the basis 
of their field testing, that the manuals are effective training devices. 
The salesmen do not agree. They feel the instructions are much too compll 
cated; that there is need for Instructional objectives, and that more vis- 
ual presentations, such as line drawings or photographs of people playing 
the games, should be Included. 

Salesmen say that teachers are not making optimal use of the games, 
contending that if they were, sales would be greater. This tonds to sug- 
gest that dissemination of the games would have been favorably affected 
If follow-up support and incentives for further use had been offered. 
But again, with a product that is as inexpensive as simulation games, 
there is not sufficient financial Incentive for salesmen to engage in 
time-consuming efforts. 



MINICOURSES 




PRODUCT SUMMARY 



Px^oduof rmei Mini courses 

DeveU>p^i Far West Laboratory for Educational Research and Development. 
;>an Francisco, California k"w(h,, 

netHbution: Macmillan Educational Services, Riverside, New Jersey 

DeeoHptions Seven Independent multimedia packages. Each package Is a 15- 
hour self-instructional course for pre- or Inservice teacher training. 
Each course consists of 6-6 lessons including! (a) a handbook explaininq 

r.JS iL^'^i^^^' (b) an Instructional film that defwnstfates^ 
and explains the behaviors, and (c) a model -test film in whieh a teacher 
demonstrates alV of the skills in a free-flowing situation. To use the 
course the school provides (a) a film projector and screen, (b) a small 
room for microteaching, (c) a part-time coordinator, (d) one hour of re- 
leased time for each microteaching practice session, and (e) a videotape 
system (camera,^mon1tor, recorder, microphone, and one reusable tape for 
each participating teacher). Developers note that an audiorecorder can 
be used Instead of the more costly Video equipment. However, because a 
participant is able to observe numerous additional teaching behaviors on' 
videotape, they suggest that it be used whenever possible. 

In using a Minicourse the trainee follows this pattern; after reading the 
handbook, watching the instructional film, and testing his or her ability 
to identify the target behaviors on the model film, the trainee practices 
the lesson's skills with about five of his or her regular pupils in a 
five-minute microteaching lessen in front of the videotape camera. SeTf* 
evaluation of the videotape th'jn takes place, and the lesson Is taught a 
second time. This procedure is repeated for each of the four or five 
lessons In each course* 

Minicourses also Incli/de a coordinator's handbook explaining installation 
procedures. The coordinator' is responsible for selecting teachers, train- 
ing them to use the equipmeiit, scheduling, and trouble shooting. 

Available courses are: 

Minicourse 1; Effective Questioning. Participants learn skills which in- 
crease the quality and amount of pupil involvement in class discussions. 
Teachers learn techniques such as pausing, redirection, and prompting. 

8!"^^?.!/*'!^ ^' Developing Children's Oral Language Qpiectlves and Skills. 
This Minicourse trains teachers to use strategies t hat wil l help children 
learn to speak and think with more precision and flexibility. 

Minicourse 5; Individualizinq Instruction in Mathematics. The course 
emphasis is on developing tutoring skins to help students wi th difficulti 
in the basic number operations and verbal reasoning problems. When the 
teacher has completed the first four lessons, he studies four techniques 
for organizing his classroom so that he has more time for rernedial math 
tutoring. 

Minicourse 8; Organizing Independent Learning at the Primary Level. 
Teachers learn organizational procedures that enable them to work wTth 
pupils Individually or in small groups while other students work Indepen- 
dently. 



Minlcourse 9 i Higher Cognitive Questlonlno. By asking students to 
support theiv* generalizations* to make predictions, and to give opinions, 
teachers learn to help children develop their abilities to think care- 
fully and logically about a subject. 

Hinlcourse 15; Organizing Independent Learning at the Intermediate 
Uyel. This course is designed to help teachers Increase the indepen- 
cent learning opportunities of their students at the upper elementary 
level. 

Hinlcourse 18; Teaching Reading as Decoding. This course develops 
instructional skills to foster pupil competency In Identifying letters, 
establishing single and large letter unit sound-symbol correspondences, 
using contextual clues to aid In decoding unknown words, and applying 
a specified problem-solving sequence to the decoding of an unknown word. 

The Laboratory has recently completed development of four additional 
couf'ses: Interaction Analysis . Discussing Controversial Issue s. Content 
Analysis of Textbooks for Black St udents, and Role Play a s'liFTn struck 
tlonai Technique^ Macmlllan Educational Services Has decided not to 
market these four courses; an alternative distributor has been found for 
one course. Interaction Analysis . 

Target mvket: The majority of courses are for elementary school teachers. 
Target buyets are principals and central office Inservlce staff. 

Co3t: Start up costs are about $1,500 for one Minlcourse. An additional 
$1,800 would be required for a videotape system If one were not available. 
(Although developers strongly recommend use of video equipment, they note 
that an audiotape recorder with one reusable tape for each teacher can 
be used In those Instances wh$re It Is Impossible to obtain a videotape 
system.) It Is assumed that most school districts have film projectors 
and a suitable microteaching room. 

Maintenance costs are minimal: each new teacher must have a handbook 
(averaging $2.50) and access to a reusable videotape ($30, or $1 If 
prorated across 30 teachers). Maintenance cost: $3.50 per teacher. 

If the developer's schedule Is followed for maximum utilization the 
cost for 600 teachers taking a single Minlcourse over a two-year period 
is about $20 per teacher, Including the cost of videotape recorders. 

(None of these figures Includes costs for release time or coordinator 
time-fboth of which are frequently absorbable through a variety of plans. 
If th«e must be added, the cost would be an additional $55 a year, and 
the overall , 600-based per-teacher cost would be: ^731) 

Evaluation: Main field test results for Minlcourse 1 indicate that teachers 
made statistically significant gains in 10 of 12 specified behaviors. 
Before taking the course, participating teachers repeated their own 
questions an average of 14 times during the 20-m1nute tape; after the 
course, they repeated their own questions only 5 times. Before the 
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course, the teachers repeated pupil answers an average of 31 times; 
after the course, only 5 times. In addition, teacher talk was reduced 
to about half the precourse level , and student responses to teacher 
questions actually doubled from an average of 5 words to an average of 
12 words after the course. Follow-up studies conducted as long as 3 
years after training indicate that teachers retain virtually all of the 
skills taught in the course. 

Similar changes In teacher behavior are documented for the other 
Minicourses. Relatively little evidence has been collected about the 
subsequent impact which teachers using these skills have upon children, 
but this issue Is now being studied in some detail. 

Cxo'vent etatua: Production of further Minicourses has been halted while 
the Laboratory studies the impact which teachers use of Minicourse 
skills has on children. 

Innovative effeota: The Minicourse represents a significant departure 
from traditional approaches to Inservice teacher training. It Is 
self-instructional, self-contained, multimedia, and targeted to highly 
specific skills. The first change It demands from most schools or 
districts is In their budaets, since start-up costs are high ^nd few 
districts have a substantial line Item for teacher training. The 
Minicourse also requires sophisticated hardware that 1$ not found in 
all districts. Scheduling and coordinating the microteaching sessions 
requires the part-time efforts of a designated staff member, and 
usually the schedule Is set up in such a way that released time and 
substitute teachers must be provided. 

Synopaia of dif fusion: Although it was assumed that Minicourses would be 
marketed through conmercial channels, this avenue does not seem well 
suited to this product. The developers, in their effort to build an 
entirely self-sufficient package for teacher training, created ai com- 
plex product with a high price tag that is tied to sophisticated 
hardware. Many users react with enthusiasm after their experience 
with the product, but many are initially taken aback by Its unfamlllarity 
and cost. Not only do salesmen have difficulty overcoming this resist- 
ance, they must take some time to understand the product themselves. 
However, their incentives are not adequate to warrant a great deal of 
effort since a district usually buys just one or two Minicourses and 
there are few repeat sales because only seven courses exist. 

Realizing that the publisher was having difficulty generating large 
sales volume, the developer applied for federal dissemination funding. 
The resulting demonstration project allowed some 5,000 educators to 
see Minicourses in operation and to form an opinion of their value. 
A study of sales figures reveals that it was primarily in the areas 
served by demonstration sites that districts bought the product; in 
short, this demonstration project seemed to work. Staff members say 
that through their extensive personal contact with site personnel tney 
were able to encourage these people to conduct the necessary outreach 
efforts, which seem to have been missing from some other demonstration 
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programs. They also note that "floating demonstrations," which 
operatdd for Just six weeks at each site, did not stimulate 
adoptions} they were too short and never sufficiently tied to a 
program of local outreach. 

Some linking agencies besides the demonstration sites also helped 
to bring about use of the product. Iflien these agencies' priorities 
encompassed the alms of Minlcourses, they were willing to supply 
the kind of Intensive effort that Is apparently necessary to overcome 
districts' initial resistance. 



ERLC 



102 



THE PRODUCT 



Mlnlcourses are self-contained, multimedia packages designed to 
develop specific coirpetencles for elementary school teachers. Based on 
a process called mlcroteaching, 6ach Mlnlcourse focuses on a set of 
carefully defined skills which make up a teaching strategy. The teacher 
practices the skills In short, videotaped sessions with a few pupils. 
In each of the series of seven Minicourses, the teacher first reads in a 
handbook about the rationale and nature of the behaviors to be learned; 
then he views an instructional film in which these skills are demon- 
strated; nPKt a inodel film tests his ability to identify each of the 
skills. The teacher then practices the skills, usually with a small 
group of pupils, in a mlcroteaching session that is videotaped for self- 
evaluation. After evaluating his performance, the teacher videotapes 
his second effort to use the new skills in a mlcroteaching situation. 
This process 1s repeated in each of the four or five lessons that 
comprise each Mlnlcourse. 

The seven available Minicourses impart general classroom skills 
that are not tied to any particular curriculurtij most of them-- 
Effective Questioning . Higher Cognitive Questionin g. Organizing Independent 
Learning at the Primary Level , and Organizing Independent Learning at 
the Intermediate Leve l—are not linked to any subject area. (The three 
other courses are entitled, Doveloping Children's Oral Language Objec- 
tives and Skills . Individualizing Instruction in Katfiema tics , and 
Teaching Reading as Decoding.) the skills to be learned are concrete: 
for Instance, in Mlnlcourse 1; Effective Questioning , they Include 
pausing, redirection, and prompting. 

To use a Mlnlcourse, a school needs to designate a part-time coordi- 
nator and provide some space and hardware. The coordinator selects 
teachers, trains them to use the equipment, sets up a schedule, and 
makes sure the process works smoothly. A small room must be available 
for the microteaching. The necessary audiovisual equipment includes a 
film projector, screen,, and a videotape system consisting of a camera, 
a monitor, a recorder, a microphone, and tapes (which are reusable). 
Although developers note that audiotape can be used in lieu of videotape, 
they strongly recommend the use of video equipment since participants 
are able to observe many additional teaching behaviors on videotape. 
Research evidence indicates that audiotape is as effective as videotape 
for teaching the specific skills in Minicourses 5 and 9; no comparative 
research has been conducted for the other Minicourses. Schools nearly 
always give teachers release time for microteaching. 



DEVELOPMENT 

In the winter of 1965-66 a few educators working at the newly 
established Far West Laboratory for Educational Research and Development 
had the opportunity and the responsibility to define how several million 
dollars of the public's money would be spent to improve education. Along 
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with the governing executives of several other regional laboratories and 
research and development centers created by the Elementary and Secondary 
Education Act of 1965, they were given a relatively free hand In decid- 
ing what programmatic efforts were most likely to improve educational 
practice. 

For the next six months, this group studied educational needs and 
discussed alternatives. People from schools and universities were Invited 
to conferences at which these needs were reviewed. This work led to a 
selection of twelve areas for further study and the development of a 
postion paper In each area. In early 1967 the executive panel, board, 
and staff of the agency then rated each according to Importance of the 
need, probability of solution, technical feasibility, and funding 
potential. According to this rating procedure, one of the two major 
needs selected for study was the improvement of teacher training programs. 

Having settled the question of what needs were to be addressed, it 
was necessary to decide what type of product or service to develop. After 
an eJ<tensive review of the literature, the staff concluded that the micro- 
teaching approach to teacher education, developed around 1963 at the 
Stanford University Schopl of Education, had the highest prospects for 
payoff. Research reports^showed that the mircoteaching method, focusing 
on a specific skill whidi the teacher practices in short lessons with a 
few pupils, was an effective method for changing teaching practices. 

The developers believed that innovation could not take place unless 
a school district was given a tangible product--a self-contained package. 
They argued that innovations like team teaching had never oeen widely 
or successfully adopted because they were vague concepts unaccompanied by 
specific or adequate Implementation directions. 

Funding for the Laboratory's development work came from the U. S. 
Office of Education. The development of a Minicoursa was a large-scale 
team effort. Involving four to eight professionals for each course at 
the peak of the work. The production»of a course took from 24 to 36 
months and each one cost between $75,000 and $325,000 to produce. Over 
5,000 teachers field tested the course. 

A thorough description of the development process is available from 
the Laboratory'; the process included the following key stages: 

Course Selection 

The need for each Minicourse was determined primarily through a 
literature review of pertinent educational research. Little systematic 
effort was made to test user interest in alternative arrays of Minicourses. 



Borg, W. R., Kelley, M. L., Langer, P., & Gall, M., The Minicourse: A 
Mlcroteachlng Approach to Teacher Education . Beverly Hills , California : 
Macmillan, 1970. " 
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Preliminary Development and Testing 

After selection of a topic and a set of skills, a rough form of 
each course was developed and was field tested with approximately 25 
potential users. The test was designed to assess the probability that 
the course would achieve Its objectives and to gather Information to 
use In revising the materials. 

Main Form Development and Peformance Testing 

After passing the preliminary testi each course was revised. 
Specific measures and standards were developed for evaluation, and 
testing was then conducted with about 50 subjects. 

Main field tests for all Minlcourses followed essentially the same 
procedure as that for Minlcoursa 1. To determine whether the course 
brought about the desired behavior?.* changes, three 20-m1nute videotape 
recordings were made of each of the 48 teachers In the main-field- test 
sample. One tape was recorded before training, another Immediately 
after training, and the third after four months had elapsed. Pre- and 
post-course tapes were mixed at random and scored. Results showed that 
teachers made statistically significant gains In 10 of the 12 skill 
areas. For example, the amount of discussion time occupied by the 
teacher talking was reduced from over 50 percent to below 30 percent, 
while the number of questions that called for higher cognitive pupil 
responses Increased by 15 percent. Teachers repeated pupil answers 
an average of 31 times during the precourse tapes but only five times 
during the postcourse tapes. Tapes made four months after the end of 
the course Indicated significant loss In only one behavior area 
(prompting) and significant Improvement In two areas; virtually no loss 
of learning occurred during the four months in the other eight areas 
measured. 

Similar field tests have beon conducted for the other six MInlcoMrses 
which have been released for commercial distribution; all provide further 
evidence that Minlcourses bring about substantial changes In teachers' 
classroom performance. 

Operational Form Development and Testing 

An operational form of the course was then developed and tested on 
a group of 40 to 200 subjects. The purpose of this test was to detertfllne 
If teachers could use the course In a practical setting without assistance 
from the developer. 

The developers wished to discover any unanticipated operational 
problems so that they could develop extra materials 1f necessary. 
Information was gathered from coordinators; teachers also made suggestions 
and provided their perceptions of the course, of their own performance. 
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Any of any subsequent changes Iri pMplls' behavior. Cottirients were over- 
whelmingly favorable, and only a few suggestions for changes were jnade. 
The handbook was revised In response to criticism that It used unneces- 
sarily technical language. 

A stuc(y conducted three years after training showed that participants 
had retained virtually all of the skills taught In Minlcourse 1. In eight 
of the ten skill areas measured, mean scores were higher for the three- 
year follow-up than they were before teachers had participated In training. 
In only one area, student use of one-word responses, was the precourse 
mean more favorable than the three-year follow-up mean. The training con- 
tinued to be effective in reducing three negative teacher behaviors! 
repetition of the question,- repetition of pupil responses, and answering 
one's own question. 

A study conducted independently of the Far West Laboratory^ indicated 
that self-feedback of the kind provided in the Minicourse is just as effec- 
tive as supervisory feedback and that practice in a microteaching situation 
is as valuable for developing teaching skills as practice with an entire 
class. Another independent study^ supported Laboratory findinqs that 
pupil participation in discussions increases after a teacher has taken 
Minicourse 1 . 

In all, the Laboratory had projected 24 MinicourseS which it intended 
to produce in the manner described above. The development work came to 
a halt when the funding for the program shifted from the Office of Education 
to the National Institute of Education (NIE). The Laboratory had evaluated 
MinicourseS only in terms of their success in producing the desired changes 
"In teacher behavior, but NIE demanded evidence that there was a demonstrable 
link between teacher skills and student outcomes. The Laboratory argued 
that It was difficult to show these linkages because many teaching skills 
have a combined Impact on student learning. The Laboratory pointed out 
that not enough MinicourseS have been developed to insure the presence of 
all the critical behaviors, In other words, the developers contended, a 
more powerful "treatment" needed to be developed before a meaningful test 
could be conducted using student success in traditional terms as the 
dependent variable. The Laboratory lost the argument^ it is now embarking 
on a research project to test the relationship of teacher behavior to stu- 
dent outcomes. Of the 24 courses proposed, seven were released through a 
commercial publisher. The publisher declined to distribute the four addi- 
tional courses which were completed recently; another distributer has 
been found for one of these MinicourseS. Work < i the other courses was 
either shelved mid-way through the testing cycle or was never started. 



^Dodgo, G. G. and Pinney, R. H., Variations of Practice Location and 
Supervision in an Inservice Training Program. Unpublished MS. Minneapolis; 
Upper Mid-west Regional Educational Laboratory, 'i969. 

%oster, G.. A Final Evaluation of the Curriculum Improvement Center , 
Elementary and secondary Education Act, Title III, ESEA Project. Punta 
Gorda, Florida: Curriculum Improvement Center, 1969. 
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From the beginning, the developers planned to turn Minicourses over 
to a publishing house for distribution* They located one publisher, 
Macinillan, that was interested In marketing the product. Developers felt 
that the product would be easily diffused, based on the enthusiastic 
responses of field-test participants* Salesmen, however, found the product 
difficult to sell and not very lucrative, In 1971 the Laboratory receivec 
funding from USOE to set up demonstration sites across the country, and 
this project seemed to be successful in promoting the sale of Minicourses. 

* ■ 

It was assumed at the outset of the development cycle that the Labora- 
tory would not be Involved in the dissemination process. This strategy 
was based on an evolving USOE policy: Laboratories and R&D Centers were 
to conceptualize and develop products, test them to insure that they would 
perform according to objective? » and then release them to a comnercial 
publisher who would be responr^^ble for production of the final form and 
for dissemination. When the first Minlcourse was ready for release, few 
publishers were interested. Only one, the Macmillan Company, submitted a 
detailed, substantial proposal; a contract was signed in late 1969, Over 
the next four years Macmillan agreed to distribute six more courses and 
has invested several hundred thousand dollars in production and marketing, 

Macmillan has approximately 150 salesmen in the K-12 division. It 
was assumed that these salesmen would both sell Minicourses and provide 
installation support to users. To supplement this sales force, the 
publisher sponsored several introductory conferences across the country 
and disseminated a nurriber of pamphlets through direct mail campaigns. 

One significant problem that began to emerge early in dissemination 
was the need to interest the salesmen themselves in Minicourses. Each 
had his own territory, most were already at or near the peak of the 
salary and coiTwnission ladder, and furthermore, most found Minicourses 
difficult to understand themselves--let alone to explain to prospective 
customers. To overcome this last difficulty, a series of workshops and 
training sessions was held for the salesmen over a period of several years. 
The problem of financial incentives was not as easy to resolve. Typically, 
only one or two Minicourses were sold to a school, yet with the same 
effort a salesman could sell a major textbook lino and get higher commissions. 
Some bonus or extra commissions were allowed eventually, but nothing ever 
made Minicourses a substantial income source for most salesmen. To the 
extent that the publisher was successful, results seemed to come from 
the efforts of one or two company representatives who followed up on sales 
and promotion efforts on a nationwide basis. 

As pressure mounted on USOE to demonstrate the effectiveness of 
educational research and development, the Minicourse was singled out as 
one of three major products to get special dissemination focus. In 1971 
the Laboratory received a grant of nearly $300,000 from the National Center 
for Educational Communications (NCEC) to support efforts to create aware- 
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ness and use of Minicourses* This grant supported the Laboratory's first 
major plunge into dissemination. Prior to this timei Its diffusion role 
had been limited to publicizing the Laboratory as a whole and helping 
Macmlllan to conduct workshops. The Laboratory was selected to receive 
the demonstration grant because the Office of Education believed it would 
be inappropriate to fund the publisher » a profit-making organization, 
directly. 

At the outset of the denionstration project, the Laboratory mailed 
announcements to the 5,000 largest school districts in the nation. The 
mailings included a letter from the Assistant Commissioner, NCEC, a letter 
from the Laboratory director, a reprint of a Newsday article on Mini- 
courses, and a return mall card. One thousand people, or 20 percent of 
the recipient?, requested information about sites where they could s6e 
Minicourses demonstrated. The returns confirmed that the locations ■ 
selected for demonstrations vsere areas where there was considerable in- 
terest in Minicourses. In four other ar^^as where there was a high level 
of response, the Laboratory decided to operate short-term "floating demon- 
strations." Laboratory staff members coordinated these floating sites 
and soon discovered that six weeks was too short a time to publicize and 
attract all teachers in the community who were interested in Minicourses. 
Visits to the center began to increase just when the site was scheduled 
to move on; since the schedule had been prepared long in advance, it 
was impossible to linger in the community and demonstrate Minicourses 
to teachers whose interest had been recently sparked. 

Responsibility for the operation of the long-term sites was given to 
local and regional agencies including one state department of education, 
two university schools of education, a university extension department, a 
county office, and a school district. This mix was deliberately selected 
to explore the effectiveness of different agencies in a linking role. 
Laboratory staff trained 21 people from these institutions in the coordi- 
nation and dissemination of Minicourses. The Laboratory served as overall 
coordinator; the linkers were instrumental In insuring maximum participa- 
tion of local schools, conductinq demonstrations for a total of 4,500 
visitors, and disseminating Information to other educators. When re- 
quested, Macmlllan was to provide follow-up information and preview ma- 
terials to people who visited the demonstration sites, 

A site was generally open one morning each week for visitors, who met 
the coordinator, watched a slide-tape overview of Minicourses, and had a 
chance to ask quesitons. Visitor-, then viewed sample course films, watch- 
ed a teacher microteaching, or talked to a teacher about his evaluation 
of the program. If the coordinator was someone other than the site prin- 
cipal, the principal also joined the demonstration to give a view of the 
Minicourse from an administrator's perspective- 
Evaluation of the demonstration project was based on forms completed 
by each visiter, a telephone follow-up study of educators who had visited 
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the sites, and an analysis of sales reports from the geographic areas 
Where deinonstratloris were made. Findings documented In the final report 
Include the following'*: ^ 

Approximately !j,000 visitors to demonstration 
sites viewed a Minlcourse In operation, had an 
opportunity to talk with a peer and reported 
that they had an experience that was useful 
In evaluating the potential of the Minlcourse. 

Based upon estimates derived from a random 
sample of demonstration site visitors, it is 
concluded that approximately one-half of the 
visitors would use a Minlcourse if it could 
be obtained by borrowing 1t from a nearby in- 
termediate agency. At the point when the sam- 
ple was taken (about three-fourths of the way 
through the contract) about ten percent of the 
visitors had already secured and used a Mini- 
course. Another 15 percent indicated that 
there was an "excellent" chance they would 
do so within the next year. 

At the end of the contract, demonstration sites 
estimated that 17,000 teachers had used or 
would use a Minicourse ar a result of the de- 
monstration effort itselv--exclud1ng uses 
derived from purchases or rentals made as a 
result of the demonstrations. 

The results also showed that the commercial 
publisher frequently failed to follow-up on 
contact leads, that there was a siqnificant 
variation In the effectiveness of the agencies 
selected to run the center, that school per- 
sonnel required careful training in order to 
serve as effective demonstrators, and tiiat the 
staffs and the Individual demonstration center 
personnel were critical in determining effec- 
tiveness. 



4 

Hutchins, C. L., and Dunning, Barbara, Final Report! A Proje ct to 
Increase the Utilization of Minicourses tHrougTTseven Regi onal Demon- 
strations . San Franci sco: Far West Laboratbry for Educational Research 
and Development, 1973. 
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As the demonstration project was drawing to a close, USOE, In a 
separate effort, selected Minlcourses as one'of ten products to receive 
major publicity through an awareness jiWbile display. From September 1971 
through June 1973 the Products Display Demonstration traveled to sites 
where presentations had b6en requested by local educational groups. The 
display featured a large audiovisual showcase for each of the products, 
along with consultant presentations. Several thousand people learned of 
Minlcourses as a result. Through December 1972, organizers of the dis- 
play forwarded to the developer about 2,000 cards requesting further in- 
formation on Minlcourses. 

To supplement the major demonstration effort and the work of the 
publisher, these are some of the additional efforts conducted by the 
Laboratory: 

a) Beginning in early 1971, the Laboratory worked out cooperative 
relationships with a number of linking agencies. An example is an ar- 
rangement with the Northern Colorado Board of Cooperative Educational 
Services (NCBOCES). A regional service center supported largely by local 
funds, NCBOCES was loaned three sets of Minicourse films during the 
1971-72 school year. In exchange, NCBOCES contacted the 66 people in 
Colorado who had responded to the mailing that launched the Minicourse 
demonstration project. It also circulated NCEC-sponsored Minicourse 
brochures and Installers Guides throughout the state* At its own ex- 
pense, NCBOCES sent one of its staff members to the Laboratory to 
receive training as a Minicourse Installer. Several months later it 
paid for a Laboratory staff member to travel to Boulder, Colorado and 
give a full day's awareness conference on the Minicourse. Of the agencies 
represented at this conference, six school districts, the SEA, and three 
universities borrowed Minicourse materials from NCBOCES to use during the 
year. In addition, several of the school districts have since purchased 
their own courses. NCBOCES also led a successful crusade to acquire 
state approval of Minlcourses for teacher recerttfication credit. Other 
similar efforts have been conducted by intermediate agencies in Iowa, 
Texas, and California* 

b) Since 1970, four R&D agencies have worked together in a coopera- 
tive network, or consortium, to increase cost effectiveness in the dissemt^ 
nation of R & D products. The cooperative network has exchanged copies 

of audiovisual and print materials and sample products for display at each 
institution. Member organizations provide joint product presentations at 
conventions and conferences; to cut travel costs, staffs of each organi- 
zation are trained to aid users in their area in the installation of pro- 
di'Cts developed by any one of the four consortium members* An analysis of 
the consortium's presentations at three conventions during the 1972-73 
fiscal year indicates that 172 respondents returned questionnaires and 
that 50 percent planned to contact one of the agencies in the future. This 
means that an average of 29 people per convention may have been interested 
In Consortium material s--hardly an impressive number of contacts consid- 
ering the expenses involved In staff members travel intj to each of the 
meetings. 
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c) other awareness campaigns were also conducted by the Laboratory 
during 1972 and early 1973: for example, Hinlcourses were publicized 
In 10,000 brochures explaining the function of Laboratory divisions and 
products. Return Interest was about 500. 



SALES FIGURES 

According to data available to the Laboratory from the publisher, 
the following numbers of Minlcourses were sold between 1970 and 1973. 
These are shown on Table 1 on the following page. The gross sales 
receipts for the courses and handbooks exceeded $900,000. 



TABLK I 

MINICOURSE SALES AND RENTALS 



MINICOURSE NUMBER 


1970 


1971 


1972 


1973 

(July) 


TOTAL 


I - 


Sales 
Rentals 


69 
48 


84 
57 


63 
18 


43 
22 


259 
145 


II - 


Sales 
Rentals 




3 


51 
12 


26 
9 


80 
21 


V - 


Sales 
Rentals 




54 
34 


&2 
23 


21 
17 


137 
74 


VIII- 


Sales 
Rentals 




2 
2 


86 
36 


39 
18 


127 
56 


IX - 


Sales 
Rentals 






64 
13 


39 
13 


103 
26 


XVIII- 


Sales 
Rentals 








? 


8 
0 


TOTAL- 


Sales 
Rentals 


69 
48 


143 
93 


326 
102 


176 
79 


714 
322 
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The target users for six out of the seven available Minlcourses are 
elementary school teachers, but there is no way of knowing how many teach- 
ers have used Minlcourses. We can only examine success in reaching insti- 
tutional purchasers » since the cost and organizational requirements of 
using a Minicourse take the decision for purchase and implementation out 
of the individual teacher's hands. What are the Institutions that pro- 
vide training for practicing teachers? There are three major classifi- 
cations: universities and colleges, intermediate service agencies and 
county offices, and school districts. 

Minlcourses require considerable adaptation for college use, although 
the developers indicate thatgthey hope to enter this market at some time. 
Nationwide, an estimated 400 service agencies and county educational 
offices provide inservice training, but funding problems make this rapid- 
ly changing market difficult and expensive to enter or maintain. The 
Laboratory has targeted Its efforts to the final audience, school dis- 
tricts. 

There are approximately 16,515 operating school districts in the 
nation^, but this large number is an unrcfalistic target from a marketing 
point of view. It is possible to achieve a manageable total by takinn 
into account -the fact that 75 percent of the student population is in- 
cluded in only 3,126,' or 19 percent of the school districts. This is not 
to say that the remaining 25 percent of the student population would not 
benefit from their teachers taking a Minicourse. The point is that given 
the constraints of dollars, time, and staff expertise, it is necessary to 
allocate resources carefully and to aim for the largest possible audi- 
ence. 

For practical purposes the primary market can be dividedginto two 
segments: the 183 large city school systems with over 25,000^ enrollment; 
and the districts from 3,000 to 25,000, which are generally found in the 
suburbs or smaller cities surrounding the large metropolitan districts. 
It has been the feeling of the Laboratory staff that different budget 
constraints, bureaucratic structures, scheduling and priority problems, 
and other factors combine to make these two types of districts require 
difference marketing approaches. 

Our staff located 465 purchasers through the year 1972, to 
determine what types of school districts were purchasing courses. Exami- 



^Office of Education, USDHEW. Directory of Educational Information Centers , 
1969, p. ill. 

^National Center for Educational Statistics, Education Directory , 1972-73 
Public School Systems , Table 1. 

^Renetzky, A. • & Greene, J.S. (Eds) Standard Education Almanac 19 71 . 
Los Angeles: Academic Media, 1971, Table 52. Figures for 1966-67. The 
3,126 districts are those over 3,000 ADA. 

^National Center for Educational Statistics, op.cit.. 



nation showed that 35 of the 183 largest school districts (19 percent) 
had purchased one or more Minicourses, and 63 of thft remaining 2.943 
school districts over 3,000 average daily attendance (two percent) had 
purchased one or more Minicourses. Considering that there have been 
251 more sales since then, ono can project a 55 percent increase in sales 
to each of these two, target audiences. This means that perhaps 54 of the 
laraest districts (30 percent) have been reached, as well as 98 of the 
2,943 medium-sized districts (three percent). Overall, five percent 
of the basic target audience of 3,126 school districts has been reachf-d. 

The remainder of the 463 sales for which the Laboratory has detail- 
ed information went to: 16 districts under 3,000; 54 universities and 
colleges; 21 service centers and county offices; and 27 others. And 99 
of the subjects purchast-d more than one course or more than one copy of 
a course. 



DISCUSSION 

Product Desig n 

The sales record for Minicourses is impressive considering that the 
product seems to be more difficult to sell to schools than a tradi- 
tional, less costly one might be. The creators of Minicourses chose to 
produce a self-contained multimedia package including high quality films 
and dependent on expensive VTR equipment for its use. One developer, 
noting that potential users are sometimes critical of the cost of the 
courses, equipment, and release time for teachers, remarked that if they 
had considered the needs of disseminators, and ultimately of users, they 
might have come up with a less expensive form for the product. Another 
developer, critical of this argument, points out that when expenses are 
divided among all teachers who use the product, it is inexpensive. Still, 
the initial impression of potential purchasers is that the product is 
costly, and distributors are put in the position of justifying the expen- 
diture to those who stay around to listen. 

' I 

Other barriers to adoption are more difficult to counter. Those 
potential adopters who reject a behavioristic approach will probably 
never bend their philosophy enough to purchase Minicourses. Others 
criticize the quality of the films, especially in Minicourse 1. The 
developers admit that the quality is not consistent; one film has won 
an award, while others are of lesser quality. Some potential users 
fault the research findings because the testing usually involved 
videotaping; they say that most teachers try to perform especially well 
when they know they are being taped. 

On the other hand, many satisfied users like the courses because they 
Involve videotaping and are a departure from traditional practice. Teach- 
ers report that they learn more from Minicourses than from workshops or 
lecture courses. Viewing model teachers on films and seeing videotapes of 
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their own performance is a valuable and enjoyable training method, they 
say. Supporters are also attracted to the courses because they can be 
conducted In the local school, teach skills that have immediate appli- 
cability, and are not tied to any one subject area. 

Since Minicourses do represent a departure from habitual school 
practices, developers knew the product would be more difficult to dis- 
seminate and implement than traditional materials. They felt that in 
order to insure widespread use, the product would have to be self-suffi- 
cient; they say that school district personnel should be able to take the 
Minicourses and use them without any outside assistance. However, experi- 
ence has shown that the courses are used more where linking agencies or 
the developers assist users with implementation. In this case, it seems 
as if the "self-contained" package the developers designed may be 
strengthened when they treat it as though it were not complete. 

The dependence on specialized equipment may have made Minicourses 
especially intriguing and Innovative to developers but also threatening 
and complicated to some potential purchasers and users. This is not to 
say that the developers should have chosen another product form, but 
that with the form they selected, special efforts at dissemination and 
implementation were necessary. 

Fi eld-Test Strategy 

The Laboratory developed and used a rigorous field-test strategy, but 
the developers fell into several common pitfalls. Subjects were not 
chosen by a systematic sampling procedure that would represent the pro- 
duct's target market; many were probably already predisposed to use the 
product. Also, data were collected on the subjects' reactions to Mini- 
courses after they !iad completed the training. This information does not 
show how potential purchasers react to the product before having any 
experience with it. 

Perhaps the most serious problem with the field tests was that they 
revolved around introducing potential users, not potential purchasers, to 
the product. Minicourse field tests did not concentrate on reaching ad- 
ministrators, and since their reactions were not sought in a structured 
fashion, the training packages were not designed to meet their perceived 
needs. Yet it is administrators who must make the ^1nal decisions to 
adopt or reject Minicourses. Similarly the "facil itdtors" were not stud- 
ied as carefully as they might havo been. From the point of view of the 
person who must locatj a microteaching room, schedule teachers, and find 
the equipment, the Minicourse often creates problems rather than solving 
them. The development and testing process did not take these obstacles 
into full consideration. 

Cont ract with a Major Publisher 

Laboratory staff members admit that they planned to turn the d1ss(>mina 
tion over to Macmillan and wash their hands of each Minicourse. In the 
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beginning both the company and tKe Laboratory ttiouqht that sales would be 
no problem since the product had proven Its worth durtng a stringent re^ 
search and development cycle. Soon, both developers and Macmillan re* 
alized that Minicourses were difficult to market. The fact that they had 
come from a laboratory did not automatically create a huge user demand for 
the courses although several purchasers were impressed by their research 
and development history. 

The union of the R&D agency with a publisher was viewed by some as 
a marriage of necessity. Despite the animosities that obviously exist, ' 
people at each agency say they benefit from the capabilities of the 
other. However, Laboratory employees are apprehensive about the ability 
of a commercial sales force to market Minicourses. They point out that 
the salesmen are used to selling textbooks; Minicourses were the first 
nonprint products that the company has attempted to sell. On the other 
hand, a staff member at the publisher notes that the Laboratory does not 
respect the experience and expertise of the sales force. She emphasizes 
that the sales,men are In contact with school administrators and teachers 
daily, and that they are more aware of what actually goes on in schools 
than many developers are. 

Both the Laboratory and the publisher know that educators need posi- 
tive reinforcement before they will Implement an Innovation. Both organi- 
zations attempt to provide this support, and both agree that the Labora- 
tory's demonstration sites had a positive effect on sales. 

De monstration Project 



As in the case of other products, simple awareness advertising efforts 
are necessary; before someone will buy a product he must know that it 
exists. Those Involved in the dissemination of Minicourses unanimously 
agree, however, that awareness efforts are not enough to lead to the sale 
of the courses. Moro Information is necessary. 

Laboratory staff members do not feel that the floating demonstration 
sites were an effective way to promote use of Minicourses. By the time 
teachers discovered that the demonstration was in town, many weeks had 
passed and the project was ready to move to a new site. Because the 
tight schedule had been set up months in advance, it was impossible to 
remain in a community longer than six weeks. However, long term demon- 
stration sites, where potential users could talk with colleagues who had 
used the product, were effective in creating additional markets for the 
courses. For the month of May 1972, 67 percent of Mini course customers 
were in geographic areas serviced by the demonstration project. For June, 
the figure climbed to 88 percent, and July sales figures indicate that 
80 percent were in demonstration areas. 

Although the demonstration project was one of the most successful 
dissemination efforts surveyed by our staff. Laboratory personnel admit 
that its effectiveness could have been greater if local demonstration 
site personnel had been given systematic training in dissemination. Re- 
alizing this deficiency early, the Laboratory attempted to compensate for 
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the lack of training by clrcuUtlng examples of, and reports on, diffusion 
techniques used at the various denronstration sites. They now stress the 
importance of keeping in close contact with site personnel. 

Cost Effectiveness 

The Laboratory has spent a total of $519,000 on the dissemination of 
Minicourses. The bulk of this sum, about $400,000, was spent in connection 
with demonstration activities, which were funded largely by NCEC (for 
$300,000) and also supported from within the Laboratory. (At one time 
the developmental programs contributed sow of their resources to this 
work . ) 

Macmillan has not done an analysis of their expenses for Minicourse 
dissemination. 

Based on the figures above, each of the 714 Minicourses sold repre- 
sents a dissemination Investment of $727 on the part of the Laboratory. 
This figure is certain to decrease as time passes, since dissemination 
activities have been cut back drastically, while more sales are expected. 
It is felt that the Impact of the demonstration project will be seen in 
sales for some time to come, since the decision-making cycle in schools is 
traditionally slow and seasonal. 

Implementation Support 

The Minicourse dissemination strategy led to a respectable number 
of sales. It is hoped that there has also been a high level of implemen- 
tation. However, the Laboratory has done little, aside from its coopera- 
tion with linking agencies, to insure that its courses are being used. 
A former Laboratory employee mentioned one large school district where 
dozens of Minicourses were sitting on the shelves; the school district was 
in the midst of decentralization; no one knew whose job Minicourse coor- 
dination was; and the materials were not used. She emphasizes that 
implementation assistance is essential in cases like this one. 



Like manv other developers, those at the Far West Laboratory felt 
that they developed a completely operational package with, what a brochure 
proclaims are "carefully tested printed materials that answer ev^Jry ques- 
tion and anticipate every need." Minicourses can indeed be implemented 
without assistance from developers and disseminators. However, in those 
schools where outside assistance is given, and where users are assisted 
in Implementation, additional Minicourses are purchased and adopted. We 
return to the question of whether an educational innovation like Mini- 
courses can or should be billed as a complete operational package. 
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MAN; A COURSE OF STUDY 



PRODUCT SUWtARY 



Px>oduot name: Man: A Course of Study 

D&veloper-' Education Development Center (EOC), Cambridge, Massachusetts, 
under grants from the national Science Foundation 

Distpibutov: Curriculum Development Associates (CDA), Washington, D.C. 

DeaoHption: This social science course focuses on three questions: 

What Is human about human beings? 
How did we get that way? 
How can we be made more so? 

The multimedia student materials have been created from ethnographic 
film studies and field research. Using these sources, classroom 
teachers and students explore the roots of man's social behavior 
through the study of selected animal groups and an Intensive examina- 
tion of the Netsllik Eskimo society. The curricylum-U, designed so 
that organizing Ideas are introduced early and ,f"ecur period icallv. 
Social science skills are emphasized. Student? siiBulate the anthro- 
pologist's methods of observation, data coneotlou,' hypothesizing, 
problem finding, and problem solving. 

Although the developers created this curriculum for 10- to 12-year olds 
experience shows that Man: A Course of Study is a nongraded curricu- 
lum which Is being implemented in elementary, secondary, and adult 
education programs. 

Cost: Basic Materials : A complete set of Super 8 mm films and five 
classroom sets of printed material (booklets, games, photo-murals, 
records, filmstrips, and teacher guides) costs $3,200. Thus the 
start-up cost for 150 pupils would be $21 .33 per pupil. However, 
since all materials are durable, maintenance costs are minimal, and 
so over five years the per-pupil expense is $4.27 per year. 

Staff Development ; A qualification for purchase is that the pros- 
pectlve buyer agree to provide necessary inservice training. The 
publisher screens all orders to verify that the purchaser has com- 
plied with teacher education requirements. A professional services 
agreement, available from CDA, enables the publisher and a cadre of 
trained consultants (the "International Faculty") to design a train- 
ing program to fit the needs of the school (s) involved. Where large 
installations occur (approximately 35 teachers or more), the pub- 
lisher absorbs some of the cost of professional services. Groups 
can make arrangements with qualified educational institutions to im- 
plement the training, or they can contract with CDA for the services 
of a trained consultant. 
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B\>atuation: The developtrs field tested HAN with 3,000 students In 123 
classrooms (grades 4, 5» and 6), Pre- and posttests showed that 
students, regardless of previous academic achieviement, acquire know- 
ledge, thinking skills, and increasingly independent study habits, 
Student interviews and classroom checklists indicated positive growth 
in self-image among students and op^n, more child-centered teaching 
styles among teachers. According it the publisher, educators through- 
out the world have continued research concerning the effects of MAN 
on both students and teachers, and have found its use to be positively 
linked with increase in reading and vocabulary scores, decreased stu- 
dent ethnocentrism, development of thinking skills, and Increased 
self -awareness. 

CtixTdnt etatuei The complete program, including inservice training, is 
available from CDA. 

lnnovativ& efj\.otet This curriculum does not fit into a traditional 
subject area for schools, since it contains material from anthro- 
pology, natural science, and other disciplines. Some of the mater- 
ial on evolution and reproduction proves controversial in some com- 
munities. Teaching with MAN can demand an unusual amount of flexi- 
bility. The initial cost of this multimedia curriculum appears 
high, especially since inservice training is required. However, 
several potential impediments to adoption have been addressed by 
the publisher i the training covers both the unfamiliar content an<f 
the new methods , and the price can be lowered through deferred pay- 
ment for the materials and various special arrangements for the, 
training. The publisher has held the cost constant for three yaars 
and has shown users that the cost should not be compared with that 
of textbooks. 

Synopeie of diffusion} The earliest diffusion efforts met with little 
success. Publishers were unwilling to take on a controversial mul- 
timedia program; workshops for teachers elicited enthusiasm about ■ ? 
the course but resulted in pilot efforts, not adoptions. 

When CDA took on MAN, its staff had no intention of applying conventional 
sales techniques to the diffusion of such a complex, controversial 
program. Instead, they have emphasized professional staff develop- 
ment in the training that is a prerequisite to implementing the course, 
Teachers learn not just content and teaching methods , but also curricu- 
lum development, evaluation, and dissemination, They become colleagues 
of the developers and of the "International Faculty," the group of 
university professors, museum anthropologists, curriculum specialists, 
and others, who conduct the workshops and engage in their own dissemina- 
tion efforts for MAN. The prestige of this group is thought to be an 
important element in the curriculum's recent diffusion success. 

COA concentrates much of its effort on key decision makers in schools. 
Evaluations of the early dissemination showed that it was school admini- 
strators with a role in staff development who were able to bring about 
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use of MAN once they were convinced of Its worth, and so COA now 
holds "awareness-toward-decislon-maklng" workshops for these admini- 
strators (followed up by similar workshops for teach^^rs). Another 
set of workshops is the "three-day institutes" designed to equip 
teacher educators to respond to the training needs of purchasers 
of the course while also disseminating irifontiation about It. Work- 
shops are also held in conjunction with the national conferences 
of various educational associations. The focus in all cases is on 
people who are in a position to take action for the program's im- 
plementation. 

The publisher's dissemination activities are evaluated cooperatively 
by the publisher and the developer, EOC, and the resulting data 
shape subsequent activities. Several barriers to adoption have been 
Identified in this way, and new tactics have been devised to over- 
come the barriers. For example, the materials ' high cost was alle- 
viated by means of a lease/purchase option that allows purchase with 
three annual payments. Problems of MAN 's discontinuity with other 
curricula are being met by working with all the teachers In a school 
and looking at the total curriculum rather than grade-by-grade adop- 
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THE PRODUCT 



Man: A course of Study (MAN) Is a complete., ungraded, upper elementary 
and middle schools program designed originally for use in grades 5 and 6. 
The content of the course was outlined by Jerome Bruner, consulting scholar 
for the development effort; 



The content of the course is man: his nature 
as a species, the forces that shaped and con- 
tinue to shape his humanity. Three questions 
recur throughout: 

- What is human about human beings? 

- How did they get that way? 

- How can they be made more so? 

We seek exercises and material s through which 
our pupils can learn wherein man is distinctive 
in his adaptation to the world, and wherein there 
is discernible continuity between him and his 
animal forbears.' 



To understand man's humanness, the course looks beyond man to other 
animals, particularly those whose lives Illuminate special features of 
our own. A young salmon, for example, manages to swim, eat, protect it- 
self, and find its birthplace five years later, all without parental 
guidance. Why are human babies so dependent on their parents? 

A major segment of Man: A Course of Study ,1s devoted to an exatnina- » 
tlon of the Netsillk Eskimo's traditional culture. Subsistence actlvi- f 
ties, child-rearing practices, the structure of a family, the ".cooperative ' 
activities of a society (all recurring concepts studied In conjunction 
with salmon, herring gull , and baboons) are Studieci in ari attempt to 
discover the distinctiveness of man. Through a study of the Netsillk and 
reflection On American society, s children come to understand that what 
people regard as acceptable behavior is a product of culture. 

Course materials are designed and sequenced so that children revisit 
the organizing ideas that are introduced early irt the course. This . for- 
mat gives teachers and students opportunities to consider concepts In 
greater depth and with deeper insight. This aspect of the curriculum 
design was strongly influenced by Bruner's emphasis on the power of 
organizing ideas to shape and stimulate thought. 



Bruner, J., Toward a Theory of Instruction. Cambridge, Massachusetts: 
The Belknap Press, 1966, p. 74. 
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The curriculum should h4 det6*inifi6<l by the most 

fundamental utidorstahding thH can be 4 

of the underlying principles that give structure 

to that subject. The best way to create interest 

In the subject is to render it worth knowing, 

which means to iflake the knowledge gained usable 

in one's thinking beyond the situation in which 
the learning has occurred. 2 

Social science skills are emphasized throughout ths course. Films 
created for the course are the primary sources of knowledge and experience. 
The deyelopers^added still photographs, field notes, and ethnographic 
journals to help present children with data that previously had been the ' 
exclusiye^proyince of social science graduate students, Children 1 earn 
the social scientist's methods of observation, data collecting, hypo- 
thesizing, and problem solving. This is not to suggest that the materials 
emphasize the cognitive at the expense of the affective domain. Storios, 
poems, and illustrations were selected with an eye for drama, pathos, 
humor, and empathy with other cultures. Activities encourage children 
to freely express their feelings and create stories and pictures that 
reflect their thoughts. 

The teaching/learning strategies in MAN are derived from Druner's 
assumption that learning is in good measure a social process by which 
children and teachers can articulate and share ideas with one another. 
The course is structu»"ed around a community of learning, rather than 
around such status-defined roles as student, teacher, and authority. 
Small group work is emphasized and the teacher is encouraged to experi- 
ment with methods which will enhance discovery and humanness in the 
learning process. 

The complete course contains 16 color films and 23 booklets which 
provide data, explore concepts (e. a. , natural selection), or' contain 
Netsilik realia (e.g., songs, stories, poems). In addition there are 
simulations, maps, filmstrlps, and records that permit children to work 
Individually or in small groups with a minimum of teacher direction. 

MAN Is an expensive product, especially in terms of start-up cost 
(although there are minimal replacement costs). It is also a controver- 
sial one dealing with subjects such as reproduction and cultural rela- 
tivism, which may be unwelcome in some communities. 

Because the course content is drawn from sophisticated areas In 
behavioral science and because the materials require that the instructor 
shift from the traditional didactic role to a more open, interpersonal 
teaching mode, the publisher stipulates that teacher education is a pre- 
requisite for implementing the course. To aid in teacher education, the 



Bruner, J., Man; A Course of Study. Occasional Paper No. 3 
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developeifs wrote nine books containing background information , bibliogra- 
phies, suggested lesson plans, strategies for evaluation, and a series of 
inservice seminars for teachers. These teacher books are an integral part 
of the resources provided with pupil classroom materials. 



DEVELOPMENT 

Man; A Course of Study grew out of a June, 1962 conference of 40 
scholars and teachers who met at Endicott House in Dedham, Massachusetts 
to consider the need and possibriity for curriculum reform in elementary 
schools generally and in social studies specifically. Those In attendance 
represented a variety of disciplines including anthropology, art, the 
classics, econOriiics, education, geography, history, law, philosophy, »» 
political science, and psychology. 

. The result of the Endicott conference was the establishment of a 
project team to develop what has become Man: A Course of Study. Jerome 
Bruner, a leader in American psychology and director of the Center for 
Cognitive Studies at Harvard University, became the director of the pro- 
jects From the outset, Bruner wanted to enlist the best talent and tech- 
niques available in the world. Later he was to state that "no person, 
whether scholar, artist, film maker, or teacher—nobody we asked for 
help refused us." 

Actual development began at Education Development Center (EDC) in 
'1963. Cross-disciplinary teams drawn from the areas represented at the 
founding meeting traveled to the Canadian Artie to film and record Eskimo 
tradition, oral legends, and myths. Others set off for Africa to study 
and film the baboon troops. At the peak of development, over 35 pro^os- 
sional staff members participated in this team effort. Simultaneous with 
this extensive field effort, teams at EDC in Massachusetts were writing, 
testing, and revising the student and teacher materials, including con- 
cept booklets on such topics as natural selection and adaptation. Develop- 
ment continued for six years and followed a research and development cycle 
of testing and revision. 

Development of Man: A Course of Study was funded by the National 
Science Foundation, which continues to support the implementation efforts. 
Costs to date are estimated at over four million dollars, including a sub- 
stantial investment in implementation activities such as workshops and 
Institutes. Development grants. Including money for a two-year revolving 
fund diffusion effort, were channeled through EDC development staff. 

Field T esting 

Initial attempts were made to test Man: A course of Study for speci- 
fic inputs and outcomes, but the developers believed that in this dissected 
context the organizing Idea, "What makes man human?" seemed to lose its 
global meaning and power. For this reason, EDC sought more comprehensive, 
reflective means of assessment. They used interviews to understand children's 
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view of the course, classroom environment checklists to understand how 
i individuals and groups worked with the materials, and pre- and posttests 
^ to Judge the consistency with which the course conveyed knowledge to dlf- 
( ferent groups of students. Over 3,000 students from 123 class. ooms in 
* 16 school districts (urban and suburban) were involved In the test period 

that spanned two school year§, 1967*68 and 1968-69. 

Research findings show that children accumulated information and also 
developed methods of investigating, problem solving, and working with 
evidence. Acquisition and retention of knowledge were achieved by all 
students, not only those with previous academic success. Several concepts 
(e.g. , natural selection and innate/1 earned behavior) were found to be 
difficult for children to understand and, consequently, were either modi- 
fied or made optional. The wide range of course materials seemed to change 
students' views of traditional data sources, de-emphasizing the role of 
the book. Students attributed success and enjoyment in learning to the 
visual materials in MAN, particularly the films, As one student put it, 
"I like to see what I'm talking about." Through discussion and small 
group work, children exchanged views, enlarging the range of one another's 
thinking, The evaluators noted increased independent, self -motivated 
learning coupled with a tendency to work in small groups without the 
teacher's direction. 

Developers state that the nature of the curriculum also brought about 
changes in teaching behavior. One Important shift was toward a more open 
teaching style, attributable to the methods and materials of the course. 
Teachers moved in the direction of an open, student-centered classroom, 
and away from domination of discussions and student work. 



DIFFUSION 

The diffusion effort for Man: A Course of Study has three distin- 
guishing features: the National Science Foundation has supported dissem- 
ination activities at a variety of levels*, the research and development 
process which created the curriculum has been continually employed to 
study the effects of dissemination efforts; and staff development has been 
a mandatory feature of implementation efforts. 

Diffusion of Man: A Course of Study has been heavily supported by 
the National Science Foundation. NSF has sponsored Institutes and other 
awareness and training efforts both before and after commercial publica- 
tion. Before Curriculum Development Associates (CDA) was selected to 
publish the program, NSF set up a two-year revolving fund arrangement with 
the developer, EDC, to allow production of an Inventory of course materials 
and to conduct dissemination activities. In 1970, GDA began developing 
its own diffusion strategy, closely tied to intensive staff development 
for teachers and teacher educators. There is still close cooperation 
among EDC, NSF, and CDA, who share responsibility for institutes and 
other training or dissemination efforts. 
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In 1968, when EOC w^s In the final stages of pilot testing the cur- 
riculum, the NationaV Science Foundatlort offered Man.* A Course of Study 
to the publishing Industry as a first step In the selection of a publisher 
and distributor/ Initial interest from publishers was high, but none of 
the 40 represented at the presentation subsequently proposed to distribute 
the program. According to NSFj two factors are responsible for this re- 
jection. MAN Is unconventional. MAN is controversial. In the 1960s» 
even more than today , the prbf i ts of the educati onal publ 1 shi ng i ndustry 
were tied to the textbook. MAN has no text* but instead is a collection 
of soft-cover booklets* games» data cards, filmstrips.photomurals, and 
films, in the eyes of the publishers, the packaging and distribution 
problems and the uticertai h prof 1 tabi 1 1 ty Of the compi ex mul timedi a market 
overshadowed the ^luality of the curriculum, they also felt that the price 
of the course would be out of reach of. the average elementary social 
studies budget. Further, the curriculum explores issues and ideas such 
as reproduction, evolution, and cultural relativism, which have rarely 
been discussed in schools with 10- to 12-year-olds. 

Because a long-standing policy which entrusted all NSF-supported 
printed material to the public domain seemed to be discouraging to educa- 
tional publishers, NSF- formulated a new policy in the 1960s. This policy, 
which is still in effect, offers publishers a fivo-year period of exclu- 
sivity during which time royalties are paid to the federal government. 
But not even this policy encouraged the publishers who were skeptical 
about marketing Man: A Course of Study. 

At this point it became clear that MAN would not find its way into 
the classrooms via existing commercial avenues, and EOC and NSF turned 
their attention to other strategies. 

The Developer as Disseminator 

After deliberating. NSF decided in 1969 to bend its policy and pro- 
vide h'DC with a revolving fund to be spent on the printing, production, 
and dissemination of 1000 classroom sets of MAN materials. NSF specified 
that the $270,000 fund would exist for two years, while EDC was to continue 
its search for a publisher. During the revolving fund phase, EOC created 
an inventory of MAN materials and sold approximately $150,000 worth of 
stock. Once a publisher was found, this firm purchased the remaining In- 
ventory, thus making it possible for NSF to fully recover its $270,000 
Revolving Fund investment. 

From the beginning, EDC, with NSF support, tied the dissemination of 
MAN to a program of teacher institutes. This program was a natural out- 
growth of the NSF institutes in curriculum dissemination and implementa- 
tion. From 1967 to 1969, NSF gave EDC $117,500 to train people who would 
recruit field-test sites and lead the dissemination for the program. 
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Between 1969 and 1971 NSF funded five Regional Centers, located In 
colleges or universities, to disseminate Information about the course 
and to train teachers and teacher leaders to implement it. During that 
three-year period, the five centers collectively used $1 ,256,400 to train 
700 teachers to use MAN. 

Although commitments were made by school districts prior to their 
teachers' involvement, only about one-third of the participants in the 
center-sponsored institutes ever taught the co\irse to students, and fewer 
than one-third ever trained more than one or two other teachers to use 
it. EDC's research indicates that the Institute effort succeeded In 
training teachers to teach MAN to students but was less successful in 
training them to disseminate and in;plement the course. 

A research and development laboratory (ERIE), whose mission was dis- 
sem nation of process-facilitated curricula, was tied Into the network of 
regional centers and was charged with involving colleges and universities 
in preserv ce and inservice training for MAN. As a result of a three-year 
effort, thirteen colleges and universities in ERIE'S territory tauqht 
teachers to use the curriculum. 

Selection of a Publisher 

io-,A ^ ""^J^r attempt to find a publisher for MAN was undertaken in 

1970, and EDC received interested responses from four companies. Curricu- 
lum Development Associates, Inc. (CDA), a new publishing company, was 
selected^because of its commitment to the coupling of staff development 
and curriculum development. According to its staff, CDA believes in pro- - 
fesslonalism (curriculum and teacher development) first and corwerdalism 
(materials) second. To give life to this philosophy, the company offers 
Its services under contract to school system curriculum development staffs 
and university departments of education, with a view toward combining 
staff and curriculum development with the introduction of new learning 
materials. Preservlce or inservice teacher training is a mandatory pre- 
requisite for the use of any materials developed, sponsored, or endorsed 
by CDA. In contrast to most companies in the education field, COA offers 
consultation, advice, teacher development, and a variety of flexible 
materials; efforts are made to apoly the lessons of one school system's 
experience with innovation to the needs in another system. 

In 1970, EDC and CDA formalized their relationship by signing a pub- 
lishing agreement and a professional services contract. Under the publish- 
ing agreement, CDA undertook to disseminate the curriculum and provide 
teacher education to any school or school system contemplating the use of 
the program. Under the parallel professional services contract, CDA 
pledged to give EDC (over and above the usual royalties to the National 
Science Foundation and other rights holders) a substantial portion of the 
proceeds from the sale of the program. These funds are used by EDC for a 
continuing review of the program, with particular emphasis on evaluation 
and new developments. In addition to providing insights Into the use of 
the program and problems associated with its introduction, this arrange- 
ment also provides for what may be a unique relationship between developer 
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and publisher. Representatives of EDC and COA meet periodically to explore 
mutual prpblerns and to review proposals for the evaluation of various 
elements of the program. 

COA took a fresh look at MAN and saw it not so much as a curriculum 
package, but as an open-ended curriculum that could contribute to staff 
&^T?I!L^f^i^l^! Its^flexibility In the hands of a skilled teacher. 
Man! A Course of Study, when viewed as an "uhflnlshed curriculum." 
empowers teachers to shape the learning environment by adding new mater- 
ials, altering the seauences to fit student needs, and encouraging stu- 
dents. to enaage In Independent investigations. As CDA personnel put it. 
they "unpackaged the package." Their staff-development program trains 
teachers not only to understand the course concepts and to use the multi- 
med a materials, but also to invent and test their own materials and stra- 
teaies. For example, the schools in Santa Paula, California produced 
films on the culture of the Mexican American} a class in Australia studied 
the changing ife style of the Aborigines j and fifth graders in Minnesota 
studied social organization of their hamster colony. 

CPA is committed to in-depth dissemlnation-preferably in a two- 
day workshop that gives participants both a broad view of the curriculum 
and active experience with the materials and teaching/learning strategies. 
COA staff refuse invitations to "show-and tel 1 " MAN because they believe 
such activity is detrimental to understandinci this /cotfiplex curriculum. 

Besides creating the concept of the unfinished curriculum, CDA has 
made a few format changes In the course. With the a#eem^^^ of the de- 
veloper, CDA made several supplemental films optional because of high 
royalties that had to be paid to the films' publishers. CDA modified 
EDC s practice of selling sample kits Of aM printed course materials 
because it was learned that people were trying to teach the course from 
the kits--no trainlng.^no films, no games, just booklets and lesson plans. 
CDA created a special $5.00 sample kit (containing one teacher guide and 
seven student booklets) and reserves the larger, more complete kit for 
workshops in curriculum and staff development. CDA made a major effort 
to promote the use of Super 8 mm film cartridges as an alternative to 
16 mm film. Super 8 is less expensive than 16 m (although not all schools 
have the appropriate projector, which Itself is a $400 item). Because 
the cartridges are so easy to use, children can view films independently. 

Ta rgeting Dissemination to Decision Makers 

Immediately after signing contracts with EOC, CDA set out to develop 
a dissemination strategy based on data EDC had generated in its early 
outreach efforts. This exploration began with the question, "What would 
happen if dissemination efforts were targeted not to teachers, but to 
leadership people with a role in staff development?" This question was 
tested by a 1971 retreat of Montgomery County supervisors and admini- 
strators (all with curriculum and social science backgrounds). In 1971 
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MAN was 1n use In only ten classrooms in Montgomery County, a district of 
oyer 125,000 students, even though many of the county's teachers had pre- 
viously participated In EDC and N$F instUutes. By 1973, after supervisora 
and adm nistrators had received 25 hours of exposure to cours$ content and 
strategies as well as auidellnes for implementation and evaluaition, 45 
schools and over 100 classroom^ were using the course, targeting dissem- 
inatlon to decision makers involved in staff development seemed to be a 
productive strategy fOr Increasing impUmehtation and, consequently, 
becanie a k$y characteristic of CPA's future dissemination activities. 

The First Three-'Dav Institutes and Their Impact 

CpA will not fill an order unless the purchaser presents either proof 
that teachers have been trained to teach MAN or a plan for inservice 
training. In light of this commitmeht to staff development and the suc- 
cess of the Montgomery County Retreat, CDA targeted a substantial amount 
of its early dissemination activities to teacher educators and curriculumt 
speclalists. During the spring and summer of 1971, CDA sponsored 11 three'- 
day institutes in an effort to create a national network of teacher educators 
who would train MAN teachers and assist In professional dissemination. 

An evaluation of this dissemination strategy has been conducted by an 
EDO research team supported with funds from CDA^s professional services 
contract. (This was the first project undertaken as an outgrowth of the 
CDA/EOC professional services agreement. ) From October 1971 to April 1972, 
the EOC staff collected data through interviews (onslte and by telephone), 
observations, and open-ended Questionnaires. Seventy-five percent of the 
Institute participants responded, and 60 percent of them reported that 
they were either teaching the course or disseminating information about it. 
The study showed that more was needed for adoption than a match between 
the course and the expressed goals of the potential user. Adoption occur- 
red when various factors came together: goals, timing, social/political/ 
organizational conditions, resources, and the presence of a supportive 
person who guided and nurtured Implementation. EDC collected its evalua- 
tion data on the three-day institutes in 1971-72; however, CDA staff point 
out that even now the impact of these institutes has not been completely 
realized. Adoption and implementation of MAN can take as little as one 
week, more often a year, and surprisingly as long as three years. 

Data then available were analyzed for three separate groups of par- 
ticipants representing school systems, universities, and state or regional 
agencies. Of all the institute participants, the school system people 
had the highest implementation record. Little implementation could be 
directly credited to the work of the university -based institute partici- 
pants, despite their contacts with schools, teachers, and administrators. 
Instead, these people seemed to have assumed support roles in dissemina- 
tion and staff development. A third group of participants, those repre- 
senting state or regional agencies, had done little work with Man: A 
Course of Study, despite the fact that as a group they had the widest 
contacts with schools and school systems. 

Why did some Institute participants fail to respond as CDA had hoped? 
The university people most often cited their educational role as the 
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explariat on. Thuy didn't teach a course where HAN could fit, or they felt 
that their role precluded endorsina any one educational product, Partici- 
pants from state and federal agencies also cited the limitations of their 
roles, indicating that as consultants; they could only respond to requests 
for help from school districts. Some state and federal agency people said 
they^would be reluctant to recommend the course because of ul high ccst 
and the risk of upsetting conservative community groups. Both the 
university and agency representatives mentioned the price of the materials. 

^ Those school system participants who had not Implemented MAN V,sted 
several reasons: high cost, continuity {what comes the year before and 
the year after?), state adoption restrictions, fear of conwunity reaction, 
and time-consuming, costly inserv ice requirements. 

In response to these perceived problems, CDA has taken a number of 
steps. Because of the concern about the high cost of the curricuium, a 
lease/purchase option was instituted^ allowing users three annual payments 
tojiuy the course. For university faculty faced with budgeting problems, 
CDA has created an Inexpensive ($125.00) Teacher Training Kit consisting 
of all components of ^the course except for films. For universities that 
desire both films and printed materials, CDA now offers a special post- 
poned payment plan. 

i. '^r^'*^^''' ^^^^"^^""^^^^^^^^"fl approached through school-based 

staff development programs designed by CDA. During this training, all 
teacher$ in a school (not only those who will teach MAN) attend a workshop 
thaVfpcuses on understand the curriculum design and the core concepts. 
This exposure is meant to give teachers enough course experience to be 
able to discuss problems of articulation and to begin developing curricula 
that can lead up to or expand upon Man: A Course of Study, 

CDA is^also exploring the feasibility of submitting MAN for adoption 
in states with flexible adoptlpn laws. For example, California has a new 
Instructional materials law which encourages selection of multimedia pro- 
grams and provides for listing up to 15 alternative books, sets, or 
systems per grade level. However, the cost of providing sample materials 
to evaluators (in excess of $60,000 for MAN) may be prohibitive. 

j:iv,oJ'^?nr°''l^'" inservice is being solved in a number of ways. 

F rst, CDA automatically provides 30 hours of Inservice teacher training 
without cost when large Installations (e.g,, Chicago Public Schools 
Jnf^f^J^'^^ ^^^l^' Second, schools, districts, colleges, and other 

11^ ^^^^ as museums or zoos, are finding diverse ways of provid- 
ing staff development support. Universities, responding to the enrollment 
crunch, have developed a number of courses for MAN teachers. CDA staff 
note that some of these colleges and universities are the same ones that 
were hesitant to endorse a commercial product several years ago. 

The International Faculty 

f<«. B^f^^'ufJ^^ Institute model was of central Importance in the crea- 
tion of the "International Faculty." During these conferences university 
professors, training consultants, social studies specialists, and curricu- 
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lum directors learned enough ftbout the curriculum to make its dissemina- 
tion one of their own professional objectives. Today COA staff believe 

{nlS^iI^*Ml°"'l ^*^"^^.^^^^^ ingredient in the dissem- 

ination of MAN. Not only do these faculty members, whose roles range 
from museum anthropologist to college professor to fifth-grade teacher, 
continue their own professional efforts to disseminate, implement, or 
teach the curr culum; they also Join forces to give workshops for NSF and 
COA at national conferences, regional meetings, and sumner institutes. 
The company believes that the prestige of this cross-disciplinary body is 
a crucial Ingredient in disseminating the program. 

Members have an obvious financial incentive, since they receive con- 
sultant fees as well as expenses. According to COA, the faculty Is also 
motivated by the professional prestige that comes from affiliation with a 
multimedia curriculum created by a well-known research and development 
center and by the excitement of the educational change that occurs when 
MAN is combined with a curriculum-based staff development program. 

NSF/AS CD/CDA Institutes for Decision Makers 

For two years {1972-73 and 1973-74), NSF has supported a series of 
three-day leadership conferences for key decision makers and teacher 
educators, held in cooperation with national education associations and 
their annual conventions. Each cooperating professional group supports 
the effort, notifying its membership of leadership conference offerings 
for the year. EDC supports these conferences by providing consultants 
from the EDC Evaluation Team to join the faculty. CDA assumes responsi- 
bility for coordinating and staffing the conferences, selecting the staff 
from the International Faculty. The Association for Supervision and Cur- 
riculum Development (ASCD) has been the national organization funded to 
coordinate all conferences. 

The first two days of the conference deal exclusively with an ana- 
lysis of the curriculum design of Man: A Course of Study; the third day' 
includes other NSF curriculum projects. Faculty members then discuss a 
variety of ways of implementing innovative curricula. 

In addition to funding these NSF/ASCD/CDA Institutes with $69,000 
between 1972 and 1974, the National Science Foundation supports a variety 
of other dissemination models including institutes for high school teach- 
ers, administrators, and social science coordinators as well as for urban 
school decision makers. NSF has also funded college educators to conduct 
suimer institutes for decision makers. 

International Diffusion 

In suirner, 1971, the Center for Innovations and Research in Educa- 
tion (CIRE) of the Organization for Economic and Cultural Development 
(OECD) and the Volkswagen Foundation cosponsored an international seminar 
on curriculum development and training. CDA was invited to present MAN, 
the only American curriculum introduced at the conference. 

As a result of this meeting, educators from Great Britain became 
interested in experimenting with English application of the curriculum 
and related staff development. In 1973, MAN was in use In four local 
O education authorities in Great Britain. The first adaptations of Man: 
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A Course of Study havo taken pi aco 1 n Engl 1 sh-speak< ng countries (Canada . 
f^SJr^'^^^u"^^"^!*"? » andGerr>dny has proposed a foreign language adap- 
iJJn-L'lJ^' 'fl '"^^Ja. that adaptation will Involve tnor^ 

than mere translation, COA and a group of German scholars have begun a 
systematic look at teacher training and the problems of cross-cultural 

SHin"Jrl^^'"ff.V;^^^^^^ the beginning that any cross- 

national work on this curriculum be based on a research effort to docu- 
TnllVf^JPj^^^^VS^* ^'^^^^^ language, values, and changes In teach- 
ing behavior and classroom environments. 

Future PI ans and Con cerns 

NSF Is still "yeiry much In the picture. Because many scholars and ■ 
^^"^ course Of study Is a significant 

8« Snf ^^E H determined that "it ought to see daylight." In 1974, 

»WM rS^^JJf - Implementation 
^IaJ^Jaa ]'' r*'^J^°"i^^^ '^°""^^t1on recently funded an EOC proposal for 
fl ?l2h^nf the curriculum (updating the Netsilik materials 

in 1 ght of the^ecent mpact of technology on the culture) and to assess 
barriers to implementation. EDC and CDA will cooperatively hold a series 
of urban conferences on the special problems that city districts face in 
implementing Man: A Course of Study. 

Urban implementation is a current focus for CDA j staff members are 
revisiting cities that began "pilot studies" of MAN several years ago with- 
out using the curriculum widely. In some Instances, CDA is finding the 
curriculum locked in an experimental school and bearing the labels for 
Innovative environments only. In other cases, all it takes Is third- 
party intervention from CDA to rejuvenate interest in MAN. In cities 
where MAN is not in use, notably New York City and San Francisco, CDA is 
studying the history of decentralization and the Impact it has had on 
decision making. 

A second current focus for CDA is school-based staff development pro- 
vided through a professional services agreement. In such a program an 
entire staff, not just those who will teach MAN, looks at the curriculum 
in terms of what it says about content and pedagogy in social science 
education. This approach can both alleviate the problem of articulation 
and stimulate creation of new curricula. A part of the school-based staff 
development Is training in conducting action research to document the 
effects of curriculum change on students and teachers. 

Several questions currently plagje CDA. How can quality control be 
maintained If there is massive diffusion of the curriculum? How can CDA 
continue to monitor the staff development requirement in large installa- 
tions? How long will NSF continue to support dissemination and implemen- 
tation? How long will the members of the International Faculty keep MAN 
on their agendas? Can the curriculum make a contribution beyond its 
original Intent (e.g., promotion of the concept of cultural pluralism)? 
How can CDA's dissemination strategy continuously respond to research 
findings? 
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SALES FIGURES 



The diversity Of ways In which schools use curriculum programs com- 
plicates the development of any precise estimates of student u.sage for 
Mant A Course of Study. Nevertheless, on the basis of fairly conserva- 
tive projections, It Is estimated that the program Is currently being 
used by at least 200,000 pupils In 1700 schools around the world, Since 
only 375 schools were using the program In 1970, this figure represents 
almost a five-fold Increase over a three-year period. 

CDA refuses to state that the market Is restricted to a particular 
grade level, because HAN Is being used In elementary, secondary, and 
adul t education programs , Nor 1 s the market conf 1 ned to school sin the 
United States. If we did assume that the market consisted of pupils In 
5th through 7th grade$~Tn U.S. schools (who are in fact the most common 
users), this would be a total of about 11,000,000,3 and the 200,000 users 
would then represent almost two percent of that market. Since the pub- 
lisher has set a far more ambitious goal of reaching students at many 
levels and in many countries, the current number of users represents a 
small percentage of a vast market. 



DISCUSSION 

Design 

The developers of Man: A Course of Study were more concerned with 
advances in the state-of-the-art in curriculum development than with future 
sales volume. The development teams were composed of university professors 
and others whose contnltment to the program was based on their excitement 
about their own subject areas, It can be surmised that what was Important 
to an anthropologist on the staff, for example, was communicating anthro- 
pological principles to children, not selling a social studies program 
to a school. By the time marketing became an Immediate concern, the 
course materials were in the form of a complex curriculum in an unfamiliar 
format, which promised great dissemination problems. 

Furthermore, the subject matter was often controversial (e.g., evolu- 
tion and reproduction), and it Included disciplines usually studied at 
the college level and unfamiliar to many elementary social studies 
teachers. On the surface this might Indicate a design flaw, at least in 
terms of marketing, but It was a conscious flaw. That is» the developers 
were undoubtedly aware that the content might impede adoption, but they 
were committed to the value of introducing this content and were deter- 
mined to convince the schools of its benefits. 



National Center for Educational Statistics, 1973. Statistics of Public 
Elementary and Secondary Day Schools » Fall 1972 . Table 5. 
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Field testing of Mans A Course of study was a continuous process 
during the six years of development at EDC. Pre- and posttosts measured 
knowledae gains, Interviews were used co discover both student and teacher 
perceptions of the course, and classroom environment checklists were used 
to find out how participants Interacted with course materials. After each 
testing cycle, revisions were made In accordance with test results. In 
other words, a conventional research and development model was followed. 
It is significant that although testing was long-term and comprehensive, 
it was solely content-oriented. It appears that no marketing concerns 
were Included In the evaluation. 

The decision to select sites almost exclusively In the northeastern 
region of the country could bo viewed as an Impediment to diffusion. A 
more wldespread^slte selection pattern might have provided more Insight 
Into possible diffusion or Implementation problems, and ft would almost 
certainly have Increased word-of -mouth familiarity with the product. 

Diffusion 

Two distinct diffusion processes were applied to Man: A Course of 
S*"^^' /SL^^r^^ was the EDC/NSF revolving fund approach, in which NSF 
provided EDC With funds to produce an inventory of course materials and 
to carry out dissemination activities. These activities consisted pri- 
marily of institutes and workshops to train teachers in the use of MAN 
materials and concepts. A major focus of the effort was to Insure that 
persons completing the course would be motivated and qualified to under- 
take dissemination activities themselves. This phase of MAN' s diffusion 
continued for four years and Included not only many workshops but also 
the involvement of Regional Centers as linking agencies to disseminate 
inforrfiation about MAN to teachers, teacher educators, colleges, and 
universities. EDC's evaluation of this effort Indicated that it was 
effective only in training potential teachers of the course but not in 
producing qualified disseminators. 

According to CDA, the weakness of the early EDC workshops was at 
least partially attributable to the choice of teachers as the primary 
target audience. When CDA began disseminating the program in 1970, its 
staff decided that because teachers are not often key decision makers 
In adopting such a complex, controversial curriculum, it would target 
its efforts to teacher educators, curriculum specialists, district staff, 
and others. This redirection appears to have had successful results, 
since implementation has increased significantly under COA's strategy. 

An equally important and unique feature of the company's overall 
strategy is its commitment to "professionalism" as a dissemination tool. 
The company contends that its diverse and extensive "awareness-toward- 
decision-making" activities are aimed not merely at teaching users or 
potential users about the design and materials of the course, but are 
intended to help teachers develop as professional decision makers. After 
training, teachers will not only be more proficient in the classroom, 
they will also be qualified to assume responsibility for dissemipation, 
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curriculum expansion, or even development. This goal may seem Ideellis- 
tlc If not overwhelming, but CDA's whole approach to diffusion of Man: 
A Course of Study Is based on the notion of staff devolopment supported 
by Its International Faculty of scholars. 

Members of the International Faculty have the Incentive of consulting 
fees, but COA staff emphasize that they also gain professional prestige 
from their association with the course. 

CDA and Us consultant staff, In conjunction with EDC and NSF, have 
mounted a comprehensive campaign to give Interested educators in-depth 
awareness of the content and methodology of MAN. Unlike other commercial 
publishers, and 1n line with Its Image of professional commitment, CDA 
declines to engage In what it calls "show and tell" awareness activities. 
Instead It organizes and provides staff for a variety of workshops and 
Institutes for key decision makers. In a unique marriage of funding 
agency, developer, and publisher, NSF sponsors some of the institutes, 
CDA coordinates the conferences and provides staff from among the Interna- 
tional Faculty, and EDC provides consultants fronvlts evaluation team. 

Perhaps the most interesting feature of these efforts is that CDA, 
through a professional services agreement with EDC, sets aside a portion 
of its sales Income to support formal evaluation of all its dissemination 
activities. Evaluation results are generally favorable; where they have 
not been, CDA has responded with changes. For example, university staff 
indicated that the complete set of materials posed a budget problem, so 
CDA developed an inexpensive ($125) Teacher Training Kit which Included 
all materials except films. School district staff had the same problem; 
since these people required films to implement the course, CDA instituted 
a deferred-payment, lease/purchase option. And they responded to suggested 
problems of articulation with staff development to help teachers begin to 
design their own curricula to precede and follow Man: A Course of Study. 
Thus it appears that with the support of NSF and EDC, CDA has been able 
to solve many of tho diffusion problems generated by the course. Without 
that crucial financial and evaluative support, iLb efforts might not 
have been so successful. 

Implementation 

The complexity of the course materials and their unfamiliar and often 
controversial content combine to make teacher training the most Important 
Ingredient in successful implementation. No prospective purchaser can 
receive materials from CDA until he has signed a commitment for profes- 
sional staff development or furnished proof that the program's users have 
already been trained, or will be trained locally. 

The cost of the extensive 30-hour training requirement set by CDA 
might seem prohibitive, but CDA has been able to convince users of Its 
necessity. This has been accomplished by stressing the professional 
advantages of staff development and also by arranging various ways to cut 
the standard consultant/release time costs. For a large installation, 
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CDA provides training staff from Its faculty, absorbing the cost and de- 
signing the sessions to fit the school's Inservlce plans. For smaller 
groups, the publisher or district can often find an education department 
at a nearby college or university that will share the cost of training 
if some preservice participation is allowed. Now, because MAN Is find- 
ing Its way into the preservice curriculum, it sometimes happens that a 
purchaser can find a member of his own district staff who has become qua- 
lified as a teacher for the course. 
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Pvoduot name: Inquiry Development Program ir. Physical Science (IDP) 

Devetopep.' Dr. J. Richard Such/nan/Sclence Research Associates (SRA). 
Chicago, Illinois 

DidtHhutor: Science Research Associates 

DesoHpHon: An elementary science program covering such fundamental 
physics concepts as force, change of state, and pressure. May be used 
as a basic, one-year course or as a supplement to the regular science 
program. The. program goal fs to develop skills of Investigative thinking 
IDP is organized around a series of "discrepant events," problems which 
are desianed to challenge students' understanding and thus Stimulate 
the Jnquiry process. One such event Involves a metal blade which, when 
heat is applied, bends upward. The students are challenged to discover 
Why the blade bends. They participate in an inquiry session, asking 
questions, conducting experiments, and using reference materials to try 
to explain the event. A final answer, or closure, is neither requi red 
nor encouraged. The problems, or events, are presented in 25 Snti silent 
color film loops, a teacher's demonstration kit, and a student Idea 
Book. ■- — 

A Teacher's Guide offers brief explanations of the physical principles 
related to tfie course and an analysis of each inquiry problem in terms 
of those principles. Since many elementary teachers do not normally 
deal with such a comprehensive range of basic physics concepts in 
their classrooms, it is also suggested that they review a basic physics 
text. Purchasers also receive a book called Developing Iriquiry . 

S'^J^Jk^^P^^^"? the philosophy and procedures of inquiry development 
and the ways in which the Tnquiry approach differs from more tradition- 
al classroom practice. 

T<a>get market: The publisher recofimends IDP for grades 6 to 9, although 
Suchman contends it can be used successfully with students from ele- 
mentary through college levels. The usual purchaser is a curriculum 
specialist or building principal. 

Cost: In 1972, the last year IDP was actively promoted, the program cost 
for a class of 30 students added up to $663.30. This cost included 
the 25 films, the teacher's demonstration kit, 15 student experimental 
kits. 30 Idea Bot>ks . 5 Resource Books , a Teacher's Guide and teacher's 
handbook kit, one Evaluating Inquiry Hand book, and 30 Student Response 
Books . After the initial program cost, only Idea Books, at $ .80 ea., 
and the Student Response Books, at $ .62 ea., needed to be replaced for 
every new class. All other materials were reusable. Thus, the expense 
averaged out to about $8 per student over three years. The cost per 
student could be reduced by using the program in several classrooms 
each year. 
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Bvalmticnt Initial mdterUls developed at the Uhlverslty of Illinois 
as part of the Illinois Studies In Inquiry Training were subject to 
extensive testing with pilot classes over a period of several years. 
Experimental and control groups were given pre- and posttests cover- 
ing inquiry skills and content mastery. The Inquiry training ap- 
proach was evaluated (Suchmani 1962 i Butts and Jones, 1966)} both 
studies showed Improved Inquiry skills and problem-solving behavior* 
but found little evidence to indicate that Inquiry training Influenced 
concept development. The Initial materials formed the basis for 
lOP but were significantly revised during final development at SRA. 
No further evaluation was undertaken. 

Cux'x'ent atatua: The program is no longer Included in the SRA catalog, \ 
although SRA will continue to fill orders for Individual items or \ 
even complete programs as long us their supply lasts. | 

Innovative effeota: The inquiry approach requires that teachers behave 
In new ways. They must strenuously avoid authoritarianism and be- 
come facilitators or even fellow inquirers rather than dispensers of 
knowledge. In practice, this means that teachers must not lecture, 
must tolerate some classroom disorder, and must use new methods for 
evaluation. The program also demands a basic knowledge of physics 
which may necessitate additional training for teachers. For adopt- 
ing schools, it is an expensive program that may cause budgetary prob- 
lems. IDP covers only one area of science and thus may have to be 
supplemented with additional curricula, especially in those schools 
where particular content coverage is required by a state or district. 

Synopaie of diffuaion: After initial development of the inquiry approach 
In a university setting, SRA became interested in packaging it as a 
science curriculum. Development of all new materials took place under 
the company's auspices, and no field testing was conducted to ascer- 
tain users' reaction. 

The bulk of the marketing effort was conducted by a network of sales- 
men under the direction of regional managers. Sales techniques were 
not particularly unconventional except for the inclusion of some 
classroom. demonstrations and workshops for teachers so as to communi- 
cate the program's approach to potential buyers. Because of the neces- 
sity for salesmen to understand the program themselves, SRA mounted 
one of their most extensive staff-training programs. The developer 
Joined in this effort to explain the complex product. He also supple- 
mented the publisher's promotional work by holding demonstrations and 
conducting training when Invited by schools and universities. 
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When It became evident that the program was meeting sales resistance, 
SRA stepped up Us efforts but still did not venture far from tra- • 
ditional channels. A starter set of materials was developed to allow 
teachers to try out the inquiry approach in their classrooms. More 
workshops were held, and a subscription newsletter was begun. But 
when sales figures still did not rise to a satisfactory level, SRA 
was forced to reconsider its Investment; management perceived that it 
was engaging in an expensive effort to create a market for innova- 
tion. With some reluctance, SRA dropped the program from its catalog 
after six years. " 

The publisher, the developer, and many users agree that the lack of 
extensive teacher training in the Inquiry approach was the most sig- 
nificant factor impeding adoption. Some difficulties may also have 
arisen because the program did not fall neatly into the traditional 
format for science programs. The program was marketed by means that 
might have succeeded for a more convantional program but were not ade- 
quate to bring about use of IDP. 
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THE PRODUCT 



The Inquiry Development Program (I DP) grew out of the commitment 
of one mfii, Dr. 0. Richard Suchm(jhr to the Inquiry learning process. 
Suchtjan believes that InqulK^y Is not a teaching method or technique^ 
tbut is In fiict " the fundamentaV means of human learning." When he be- 
;gan h1sJn1t1al development of Inquiry training In the late 1950s, he 
jwas^motlvated by the feeling that traditional education stlflls the 
child s Intrinsic desire to Inquire, to acquire Information and process 
It. He found that school environments generally use "ego and social 
needs to motivate children to conform rather than to inquire, to store 
facts and generalizations rather than to search and discover for them- 
selves." 

In a traditional lecture presentation, for example, a concept may 
be introduced simply because the teacher has chosen to teach it at that 
time. Often no immediate use for this concept is apparent to the stu- 
dent, who is Instead motivated to learn merely by the desire for ap- 
proval or a good grade. One way to counter this approach, according to 
Suchman, is to present students with an event or object that makes them 
curious, to build irresistible pressures In the children to find a way 
of assimilating the event. 

In an inquiry session, the student observes a discrepant event 
which challenges his or her beliefs about reality. Presumably this 
stimulates him to find an explanation for the discrepancy by gathering 
data and forming theories. The inquiry teacher can then introduce con- 
ceptual organizers the student will recognize as immediately useful 
because they will help to close the gap between his beliefs and his 
observations. In this case, his desire to find more meaning In his own 
data and theories motivates him to learn the concept. 

Based on this theory of learning, IDP was developed as an elementary 
science program for use either as a complete, one-year course or as a 
supplement to a school's regular science curriculum. The program is 
designed around discrepant events or problems, which present each of 
a puzzling, seemingly inexplicable event in a film, a teacher demonstra- 
tion, or a printed picture In the students' Idea Book , the 66 problems 
are arranged in a recommended sequence to form a complete, one-year 
course. The sequence begins with relatively simple treatments of the 
physics concepts in the course (e.g., force, change of state, pr(issure) 
and progresses to more complex treatments. All of the major topics are 
covered in the first third of the course and are then reintroduced at 
a more complex level in the rest of the problems. 

After a problem has been presented to the class, the student and 
teacher engage in an inquiry session to try to explain the event. The 
original structure of these sessions was a kind of question game in 
which the students could ask only data questions that could be answered 
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yes or 'no." Subsequently, Suchman has revised this rigid approach, 
so that in workshops and training s'^sslons teachers are encouraged to 
bewe f axible In answering questions, as long as they do not fall back 
Into traditional exposition. Printed program materials, however, stni 
reflect the original restrictions on question asking. 

If class questions alone do not elicit enough Information to satis- 
factorily explain the event, the teacher encourages the students to In- 
vestigate further. They use equipment from Student Experimental Kits to 
test the theories produced during the Inquiry session. They may also 
refer to the Resource Book , a hardcover collection of reference material 
related to the physics concepts 1n the course. Further verbal inquiry 
may follow, although the program does not require that each problei.i be 
solved as It 1s presented. In fact, a final solution Is not the pro- 
gram s goal. Instead, I DP attempts to develop skills of investigative 
thinking. 

The program also includes student evaluation material, not for the 
purpose of grading, but rather to help the teacher observe the develop- 
ment of each student's inquiry strategy. After viewing each of the 25 
films, students answer true-false questions in a Student Response Booklet . 
A teacher's handbook, called Evaluating Inquiry , explains how to inter- 
pret the students' written responses and thoir classroom behavior. Ac- 
cording to Suchman, testing in lOP should help the teacher to 1) judge 
the student's inquiry technique and his understanding of the inquiry pro- 
cess; 2) size up the structure of the student's knowledge; and 3) measure 
the specific information acquired using ID^. 

Implementation of IDR jnay present prible/ns for elejnentary te<tchers 
In two SDectfic areas. The inquiry phtlosopKy Itself demands stgriiftcant 
changes in teacher attitudes and behaviors. The teacher must abandon 
his or her role of expositor for that of facilitator or even fellow in- 
quirer. He must be willing to say, "I don't know" if he doesn't, and to 
accept the fact that there are no exclusive "right" answers. Further- 
more, without right answers, conventional grading becomes at best a dif- 
ficult and arbitrary process. A traditional teacher might also feel 
that he had relinquished much of his usual direct control over the 
students in his class, since the typical inquiry classroom simultaneously 
involves large groups, small groups, and Individuals who are doing ex- 
periments, discussing problems, reviewing film loops, walking around 
from group to group, or reading. 

The second problem encountered by IDP users is the apparent need 
for extensive science background to teach effectively with the program. 
The teacher materials published by SRA recorrmend that in addition to 
reviewing the information in Developing I nguiry and the Teacher's Guide , 
the beginning IDP teacher review a basic physics text. According to 
a curriculum specialist in one large district using the program, even 
this is not enough. In fact, he says his teachers all needed inservice 
science instruction in order to feel at all comfortable in answering 
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the questions posed by students about discrepant events. However, Or. 
Suchrrtan, the program's developer, contends that In depth knowledge of 
physics Is not necessary If the teacher 1$ convnltted to Inquiring alon 
with the students. ^ 



DEVELOPMENT 

Suchman's work with Inquiry began In 1957 at the University of 
Illinois, where he was a professor of elementary education. His 
Interest was originally sparked ty the potential of television to stimu- 
late thinking and learning. At the same time he became aware of some 
research on question asking that showed that about 97 percent of the 
questions asked in the elementary school classroom are asked by the 
teacher. Initially his research focused on the problem of training stu- 
dents to become more effective question askers; later he broadened his 
notion of inquiry to include the whole process by which we create our 
own knowledge through self-generated experiences. 

Initial research In Inquiry training was funded by a small grant 
from the University of Illinois. During the first two years, Suchman 
decided to abandon the medium of television, primarily because of its 
limited flexibility. If it were broadcast Into the home, no feedback to 
viewers was possible, while with closed-circuit educational television 
In the schools, the teacher could not control the timing of the broad- 
cast or Interrupt it for discussion. Instead, Suchman decided to use 
short films which could be presented at any time by a teacher In the 
classroom. Each film would show an event designed to challenge the 
student's beliefs about reality, thus motivating him to ask questions 
to try to explain the event. 

Results were promising, and in 1969 Suchman received a larger grant 
from the U. S. Office of Education (Title IV, National Defense Education 
Act) to initiate the Illinois Studies in Inquiry Training. Thirty-three 
physical science films were developed as a result of this study, and 
Suchman began to test the effects of the program on sixth-grade children. 
Six experimental classes saw problem films and participated in inquiry 
sessions at least once a week. Six control classes saw the same films, 
but instead of conducting inquiry sessions, their teachers taught the 
principles illustrated in the films by traditional expository methods. 
Evaluation was conducted by means of pre- and posttesting. At the end 
of 24 weeks, there was no difference in conceptual growth between the 
two groups; however, the experimental group did show a significantly 
greater proficiency in terms of fluency of question asking and the de- 
gree to which their questions were analytical. 

In his analysis of three pilot studies early in the Inquiry Train- 
ing project, Suchman found that after a 15-week period of inquiry ses- 
sions, students improved in verification and experimentation, formula- 
tion and testing of hypotheses, and development of consistent problem- 
solving strategies. 
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In 1962, OE awarded a second grant, this time through the Coopera- 
tive Research Program, for further Investigation of inquiry training. 
The grant made it possible to develop another series of problem films, 
this time dealing with economics and physiology. 

Around the time that OE support was about to run out, a colleague 
suggested to Suchman that the Inquiry Box» an adjunct to the inquiry 
films, was a potentially marketable item. ^{Various objects can be as- 
sembled inside the box Into a mechanical linkage with parts protruding 
through holes in the sides. After the teacher or a student assembles 
the pieces, the closed box is presented to a student, who tries to gather 
data, make inferences, and fomi theories about the contents of the box.) 
SRA, recommended as a potential marketer, showed only a lukewarm reac- 
tion to the Inquiry Box. The company was, however, strongly interested 
in Suchman s inqury training work. Probably Influenced by the emphasis 
that science received In the early 1960s, they felt that the materials 
could be developed into a saleable elementary science program. 

The partrfership of developer and publisher began In 1964, when 
Suchman began working at SRA to create the Inquiry Development Program 
In Physical Science. For the first two years, this was essentially a 
part-time effort, as Suchman also held the position of Director of Ele- 
mentary and Secondary Education Research at the U. S. Office of Educa- 
tion.* 

The first problem faced by the developer/publisher team was the 
question of using the existing content of the program. The original 
films had been developed under University of Illinois and USOE grants 
and were therefore part of the public domain. Because the public do- 
main concept was confusing and discouraging to the publisher, it was 
dec.ded that Suchman should develop an entirely different set of ma- 
terials. In effect, IDP would become a new program based on the model 
of inquiry training that had already been tested and verified in 
Suchman s earlier work. Beginning in 1964, two m staff editors and 
a physics consultant worked with Suchman on the new materials. They 
developed a comprehensive sequence of interrelated physics themes and 
the 25 problem films. 

at this point that SRA's impact on the development and design 
began to be noticeable. For example, a decision was made to include 
some experimental equipment for teachers and students. It was true that 
as far as the publisher was concerned, tki idea of organizing the program 



Note: IDP' materials were not developed by Dr. Suchman in his USOE 
capacity and no official support or endorsement by USOE was intended 
or should be inferred. 
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T? "^u\l^* Jit ^ ^^^^ ^^°P^' """^^^^^ "Sing equipment, W5S attractive. 
fn^'Ar^tL^i^l' '^^^^ felt they could present a laboratory approach 
tL?A'. without the expense and complications of laboratory equipment. 
They were convinced that the quality of demonstration In the films Sas 
Of value to the elementary teacher, who was often inexperienced or had 
little content expertise In science. They were aware that buyers were 
often looking for a complete program, but SRA staff felt that It was not 
in the company's best interest to develop and publish large quantities 
of complex J aboratory equipment and supporting materials. And, after 
ail, use of media was becoming Increasingly popular In the early 1960s, 
and^fllm loops and even the loop projectors SRA planned to sell fit In 
perfectly. 

Nevertheless, it was decided that the program materials should 1n- 
^^jxu rnr!.^^P^*'^l"^"*^! equipment. Why did this happen? Suchman agreed 
with SRA that such equipment would add to the program's usefulness, giv- 
ing the teacher opportunities to present real events. The choice of 
materials was also influenced by an economic motive on the part of the 
publisher: if the equipment could be produced inexpensively, the high 
cost of developing the films could be partially offset. No research or 
testing was conducted to justify either the use of equipment or the oar- 
ticular items chosen for the equipment kits. 

Another set of materials was added during development at SRA, again 
in an attempt to include more saleable items in the published program. 
These were printed materials, Including a hardcover Resource Book , con- 
taining reference material for students conducting Investigations; and 
an IdeaBook, inexpensively printed, which was given to each student and 
which had to be replaced for each new inquiry class. A Teac her's Guid e 
provided extensive information on both the philosophy of inquiry and the 
subject flatter of physics in order to allay some of the fears of users 
and purchasers who had little background in either area. The guide 
was accompanied by a half-hour phonograph recording of an inquiry session 
conducted by Suchman himself. The development of these last two items 
indicates that the publisher was well aware of the Implementation prob- 
lems that could be created by the inquiry method. Neither Suchman nor 
SRA, however, was yet aware of the magnitude of the teacher training 
problem. 

Finally, an evaluation component was added to the program, largely 
at the insistence of the publisher. Although Suchman had seen in his 
Inquiry Box possibilities for evaluating while helping to strengthen a 
student's inquiry skills, he felt that testing and evaluation in the 
traditional sense were antithetical to the inquiry process. SRA, on the 
other hand, felt that the program must respond to the teacher's need to 
test students with objectives spelled out in some detail. The publisher 
was especially concerned with the need for accountability due to the in- 
novative nature of the inquiry approach. A compromise was finally 
reached. In which Suchman developed a book called Ev aluating Inquiry and 
an accompanying Student Response Book. Both were open-ended enough to 
suit Suchman and were not related in any way to grading, yet they pro- 
vided Information for teachers. 
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DIFFUSION 

SRA's diffusion strategy was In general similar to strategies used 
by other large, sophisticated educational publishers. One component 
of the company's staff is devoted entirely to market analysis and pro- 
^52 ui? ?^c1sion has been made by marketing staff and content 

experts to publish a product, the main sales effort is delegated to a 
widespread regional sales force. This group, reinforced by advertising 
and other awareness efforts on the part of the company, contacts schools 
and districts all over the country in a direct sale campaign. At the 
same time. Suchman's own extensive Inquiry demonstration and training 
activities continuously provided lOP with considerable; public exposure. 

Dissemination planning began in the early stages of SRA's involve- 
ment with the program, with marketina staff examining other science 
curricula and their attendant marketing strategies. Program and com- 
ponent prices were determined through use of standard, comprehensive 
marketing techniques such as unit forecasts. SRA's large investment in 
product development was added to production expense and weighed against 
the prevailing market price of similar products to arrive at a price 
that would yield a reasonable profit. 

Simultaneously, subject matter experts examined the problem of ap- 
propriate grade level. They held a limited trial of program materials, 
mostly in the Chicago area. Although this was not a formal evaluation, 
the staff felt that lower elementary grade teachers found the materials 
too sophisticated. The company decided to aim the program at grades 
6 to 9, although Suchman maintains that with proper training teachers 
can use the process effectively with students from 4th grade through 
college by simply adapting the content and terminology. 

Actual dissemination began with the proaram's ouhlication in 1966. 
The marketing effort was conducted by a network of approximately 175 
staff associates who operated under area and regional managers. These 
managers were fairly autonomous in their choice of specific sales ac- 
tivities and usually handled training liaison between the central office 
staff and the salesmen in the field. Sales techniques were similar to 
those of other educational publishers: representatives contacted dis- 
tricts and schools in their area and provided information about SRA 
products. In the case of IDP, verbal or printed descriptions and even 
sample materials were often not enough to promote sales, and so time- 
consuming demonstrations with students, or workshops for teachers, became 
necessary. 

In general, selling IDP was considerably different from selling a 
more conventional, easily understood curriculum program. For this 
reason, according to both salesmen and central staff, SRA mounted one 
of the most extensive staff training programs that it had ever attempted. 
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Suchman conducted Inquiry workshops with central office personnel* who then 
traveled to each region to train associates. Whenever possible, the traln- 
ina was conducted with groups of children In a school setting, so that 
salesmen could see^the program In operation a/id learn to conduct their own 
demonstration sessions In the schools. The training effort was continuous, 
at least during the early period of dissemination. Suchman held repeated 
meetings with sales staff and managers. He developed a series of auciio 
tapes* discussing the theory and process of Inquiry, which salesmen could 
listen to in their cars as they traveled. 

salesmen also had to absorb information about 
other SRA products, the >ffort to train them in the principles of IDP 
seemed highly successful. According to both salesmen and central staff, 
the entire sales force became highly motivated by IDP. Not only were they 
conyinced^of its educational value, but the program also represented a po- 
: volume, high dollar amount item, since one sale might amount 

to $700. Among the thousands of products 1n the SRA catalog, only a 
few programs approached this cost. 

Several techniques in additis^n to the sales network ware used to In- 
crease awareness of IDP and encourage sales. Suchman went on extended 
tours, holding demonstrations or training workshops at invitational meet- 
ings which were organized by interested school districts, colleges of ed- 
ucation, and other educational agencies. Occasionally the salesmen them- 
selves, especially in large districts, would put on demonstrations to 
acquaint potential buyers with the program. SRA also sponsored exhibits 
and advertising through normal publishers' channels, including state, 
local, and national professional meetings and conventions. 

As time went on, reports from the field indicated that despite exten- 
sive demonstration efforts on the part of the salesmen, the program was 
meeting resistance from potential purchasers and users. Since IDP was its 
basic science program, SRA initially put considerable time c\nd resources 
into combating the resistance. In addition to creating and publicizing 
more training workshops, SRA began a subscription newsletter on the inquiry 
approach. Similar newsletter services were available for several newly 
published SRA products; they were designed as inservice aids providing 
information on background and learning theory, and tha inquiry newsletter 
offered practical suggestions which would help inservice coordinators to 
set up inquiry training courses. A new installment was Issued once or 
twice a month, so that Information was always current. Although the news- 
letter was intended-for inservice use, SRA found that many potential pur- 
chasers subscribed in order to obtain more up-to-date and relevant Informa- 
tion than was available in the program materials themselves. 

A more direct response to the sales problem was the packaging of Such- 
man's theoretical book, Developing Inquir y, with a 33 rpm recording of a 
classroom incjiry session on one of the problem events in IDP. This pack- 
age, called a Teacher's Handbook Kit , was specifically designed to appeal 
to prospective users who were not willing to purchase any of the more ex- 
pensive components without more in depth information about the course. For 
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tnose who wanted more than mere Information, and In fact wanted to try the 
program 1n their classrooms before dec1(^1nQ to buy, SRA developed a Starter 
Set. The set consisted of five problem films and one piece of teacher 
demonstration equipment, called the pulse glass. Printed Information was 
included In the form of two program booklets, the Teacher's Guide and 
Developing Inquiry . 

None of these efforts brought Immediate success, although the pro- 
gram, especially the films, was selling moderately well. Eventually, 
SRA management felt Impelled to put a celling on the science dissemina- 
tion effort for reasons of cost effectiveness. In 1972, after about 
six years of marketing, SRA finally decided to drop the program. The 
company and Its sales representatives found they could do better by con- 
centrating on programs which were less of a philosophical departure, 
demanded fewer changes In teacher behavior, and thus were more marketable. 
At this point it was decided that despite a belief in the goals of the 
program, this diffusion effort was not financially viable. The market 
was not ready for the program, and making it ready would require an in- 
vestment in dissemination and implementation support that SRA could not 
make. 



SALES FIGURES 

IDP did not prove profitable enough for SRA to continue publication. 
Based on SRA estimates, which are reported as conservative figures, over 
1,000 programs were sold during iDP's first four years on the market, 
followed by a drop to about 100 programs per year in the next four years. 
Sales of materials indicated that each program reached an average of 60 
students per year. 

If each of the 1400 purchasers used the program for only one year, 
about 84,000 students would have been reached. On the other hand, if 
every school had continued using the program every year since acquiring 
it, there would have been about 450,000 students Involved. 

Over the eight-year period, we can estimate a total target audience 
for IDP of 36,900,000 students in the 6th, 7th, and 8th grades.* (Accord- 
ing to SRA, although the 9th grade was listed as a target in the sales 



*This estimate is derived from the Statistics of Public Elementary and 
Secondary Day Schools: Fall, 1972, U.S. National Center for Educational 
Statistics, Table 5. Since enrollment figures for elementary grades have 
not changed significantly in the past few years, our total figure was found 
by adding together the enrollment figures for grades 6, 7, and 8 and then for 
each year from 1967-68 through 1973-74 adding 3,700,000 or the projected 
equivalent of a new 6th grade entering. 
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cataloa, the sales force never actively promoted the program for the 9th 
grade.) Our minimum figure of 84,000 users represents 0.2 percent of this 
audience, and the maximum figure of 450,000 represents 1.2 percent. Thus 
we can conjecture that only about one percent of the target students have 
used lOP. 

The program did not reach the high sales levels that would have been 
required to cover the unusually high cost of development and production. 
For this reason SRA was finally forced to stop publication and dissemina- 
tion of the program. 



DISCUSSION 

SRA's original decision to market IDP was based on staff members' con- 
viction that the inquiry approach, developed, tested, and validated by a 
reputable educator, could form the basis of a one-year elementary science 
program. Their initial assumption was correct, but they failed to realize 
that there Is often a vast difference between a validated educational con- 
cept and its successful implementation in the schools. Suchman's idealism 
was infectious: he felt that once teachers and school personnel saw that 
the inquiry process could work in their classrooms, they would willingly 
press for its adoption. What neither Suchman nor SRA considered was the 
ingrained resistance to behavioral and attitude changes of the magnitude 
required by IDP. Primarily for this reason, sales of the program did not 
rise to their anticipated levels, and the provjram was ultimately dropped 
from the SRA catalog. 

Conceptualization 

Since Suchman's successful inquiry research prior to joining the SRA 
staff had used problems, or discrepant events, as the focus for inquiry, 
it was a reasonable decision to use the same kinds of problems as the basis 
for a commercial version. What does not seem reasonable was an assumption 
on the part of both developer and publisher that because the inquiry ap- 
proach had worked with Suchman himself or with teachers extensively trained 
by him. it would work equally well with minimally-trained teachers in 
schools throughout the country. The point is not that the content of the 
program is flaw^^d, but rather that the changes In attitude and classroom 
practice required by the program pose often insurmountable diffusion and 
implementation problems. The inquiry teacher must not only give up his 
expository role, but he must also, at least seemingly, forego direct con- 
trol over classroom activities. A class may split up into groups for dis- 
cussion, experimentation, consulting other reference material, or reviewing 
the problem film, and there is often a relatively high noise level and 
continual moving back and forth. 

Another design problem involves the conduct of the question/answer 
session itself. Printed program materials and instructions to the teacher 
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reflect Suchman's original approach* which restricted acceptable questions 
to those which could be answered "yes" or "no." "What Is It made of?" or 
"Why did It fall?" were questions that the teacher had to redirect. The 
Idea was to make students aware of the kinds of questions they were asking 
and to help them refine their questioning strategies, but teachers regarded 
the restriction as another somewhat threatening aspect of the new program. 
It Is Interesting to note that Suchman has since revised the session 
structure considerably, allowing for more free discussion and almost any 
kind of question. His new approach has not found Its way to prospective 
or current users, since SRA decided that sales figures did not justify 
program revision. 

Not only did the question/answer format pose a threat, but the amount 
of knowledge apparently required to answer the question's was often unset- 
tling to teachers. Suchman contends that no extanslve science background 
Is necessary to teach the course. The problem Is that even If he Is right, 
this point Is not made clear 1n the program materials. The Teacher's Guide 
provides brief explanations of the scientific principles covered in the coul-se 
and examines each problem In terms of those principles; It also recomnends 
that teachers review a basic physics text. For elementary teachers with 
little background In physics, a printed explanation may not offer enough 
help to make them feel comfortable about a problem. Suchman also states 
in the materials that In order to teach In the Inquiry mode, the teacher 
must be able to say something like, "I don't know; how can we find out?" 
That is a perfectly respectable answer, but It seems to take more than 
printed, descriptive material, or even a recording of an Inquiry session, 
to convince most teachers. 

Format 

According to Suchman, SRA did not consider any alternative to the film 
format when they began to develop a commercial version. First of all, the 
films had been tested in the classroom, and secondly, SRA was intrigued by 
the idea of producing a program that conveniently offered a laboratory ap- 
proach without quantities of laboratory equipment. As development progressed, 
however, staff began to feel that with the current movement toward hands-on 
learning, including at least some equipment might enhance the acceptability 
of the course. And, if it could be produced cheaply enough, volume sales 
might help to offset the enormous development and production cost of the 
films. Although Suchman was Involved in the development of the equipment 
to some extent, none of it was ever formally tested either from a content 
or marketing perspective, and in fact, Informal feedback indicated that 
teachers wanted better equipment and more of It. 

Cost 

Although marketing staff did use standard techniques to determine the 
program's cost, some school people argue that it is too expensive for 
them. The overall cost for IDP is nearly $700, which may represent a sig- 
nificant portion of a school's science budget. Yet IDP is at best only a 



ERIC 



154 



?!)AI^®*^i^^"*'^® "^^^ « ^ supplementary program. So after a 

5700 outlay, the school Is still faced wUh completing Its science program 
for the other grades. 

Related to the cost problem Is concern for the "fit" of the program 
content with science requirements of different states or districts. Accord- 

f P"5^^^"6r, the process nature of the program made It somewhat • 
difficult to determine whether required subjects were covered, since there 
were no convenient chapters or other units labeled with science categories. 

Testing 

All formal testing of inquiry materials took place under the grants 
Suchman received while at the University of Illinois. 1957-63. The main 
emphasis of the validation was on the inquiry problem films. Both pre-post 
and experimental/control methods were used in pilot classrooms, and results 
Indicated that the materials were successful in improving inquiry skills 
and problem-solving techniques but had little Influence on content mastery. 
Further, although SRA finally set its target market at 6th through 9th grade, 
all the testing was done at the 6th grade level. 

U is significant that none of the new materials developed at SRA 
was tested at all. The rationale was that since the inquiry concept had 
been validated, materials developed in accordance with that concept were 
bound to work. Informal feedback suggests that they do work-with trained 
teachers who like the product. Since no operational testing was conducted, 
the publisher did not discover until too late that many districts and 
teachers had major problems implementing the program. It seems logical to 
conclude that testing with the specific target market would have brought 
some of these problems to light. 

Diffusion 

1 SRA's diffusion strategy was comprised of the standard tactics of a 
large publisher. Based primarily on the activities of about 175 salesmen, 
It also Included awareness advertising, convention exhibits, and numerous 
demonstrations of the program, both by SRA staff and Suchman himself. None 
of these efforts was ever formally evaluated, and when sales figures did 
not achieve expected levels, the publisher's response was more of the same 
techniques. SRA concluded that although it enjoys a reputation of being 
an extremely innovative publisher, the expense necessary to develop and 
implement entirely new diffusion techniques was too great to consider. 

For SRA's existing sales force, the company appears to have engaged 
in a training effort more intensive than it had ever before tried. This 
suggests a publisher's representatives, no matter how well trained, are not 
the appropriate people to present such an educationally innovative product. 
One of the company's salesmen suggested that trained content specialists, 
readily available to discuss and demonstrate IDP, would h«ve helped him 
make sales. But even this approach would have represented a major expense 
to the company. 
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Implementation 

Program Implementation was the source of a major problem for SRA. Once 
the program was purchased, the publisher provided no consistent system of 
Implementation support for users. First of all, SRA had not determined that 
the structure and strategies of IDP would present the kind of threat to 
teachers that It did. By the time user resistance became apparent, the ex- 
pense Involved In providing support was prohibitive. SRA central staff, 
salesmen, and the developer himself all agree now that teacher training in 
the Inquiry approach Was crucial for program use. As It was, significant 
efforts were made to provide training upon request, but the efforts were 
unsystematic and In fact undependable, since they rested on the availability 
of Suchman or other Inquiry experts to conduct training courses. The sub- 
scription newsletter on Inquiry theory and practice was one attempt to deal 
With the problem, but It was hot enough to fill the gap. There Is a consensus 
among people Involved with the program not only that significant Inservlce 
training was needed, but that In fact Introducing the Inquiry approach widely 
at a preservlce level was a real necessity. 
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PRODUCT SUMMARY 



Progx^m name: Drug Decision Program 

Developer: Lockheed EducationalSystems, Sunnyvale, California 

DistHbutopi Universal Research Systems, Inc. , Sunnyvale, California 

DeeoHpHon: This program provides Information about drugs and their uses. 
The program contains 19 units, each designed to be taught In a 45- 
minute period. The number of class periods can be reduced by Increas- 
ing the number of units per class session or stretched by covering less 
each period. An abbreviated form can be completed In 15 class sessions 
bv eliminating four specified units. The 19 units are divided Into 
five major phases: Disaster Management, Effects of Drugs on Han, Stopping 
Drug Abuse, Drug Attack Game, and Rehabilitation. 

A multimedia programmed approach is used. For each major phase and 
unit, students first complete a programmed text section in their stu- 
dent manuals and then view color cartoons and films designed to rein- 
force what they have Just read. In the Drug Attack and Rehabilitation 
phases, the students simulate decision making through. role playing and 
gaming. 

Toilet mcwket: Students in grades 6 to 8. Target buyers are principals 
and central office curriculum staff. 

Coot: Start-up costs of $3.50-5.00 per student Include a reusable student 
manual and a consumable student workbook. Other one-time costs are: 
film set for $750 (or rented at $1.00 per student), copies of the drug 
attack game for $8.00 (ten per class), and teachers' manuals ($7.00). 

Eoalmtion: Tests conducted by Lockheed show acquisition of knowledge on 
the part of students and a change of attitude away from using drugs, 
but there is no evidence to indicate behavioral changes. For this pro- 
gram, as for other drug programs on the commercial market, the develop- 
ers found many of the early testing Instruments Inadequate and pro- 
cedures unsophisticated. They therefore hesitate to quote any data. 

Cupvent status: The fifth edition of the student manual is now being 
distributed. Minor factual revisions have been made to update the 
print materials, but no content changes have been made in the films. 

Innovative effeots: Implementation of this program may cause scheduling 
problems because of its length; it requires 19 class periods for com- 
pletion, and it is so tightly structured that a teacher cannot easily 
divide it. The start-up cost is relatively high for a program that only 
supplements other curricula, but the current publishers attempt to al- 
leviate this problem by helping schools find outside funding. 




Synopeid of dtffuston: The program's developed, Lockheed, was one of many 
industrial and business firms that broadened their scope and entered the 
educational market with confidence In their ability to transfer knowledge 
and experience obtained from other fields. After a disappointing volume 
\i 2^ 1 .u^^^^V*^^"^^*^ ^^^^ inadequate analysis of user needs, Lockheed 
modified the product and began traditional educational marketing techniques 
such as advertisements in educational magazines, conference displays, 
mailings to superintendents, and direct sales calls to districts. These 
tactics were continued and expanded after the sale of the program to Technicon 
Educational Systems. Universal Research Systems now helps would-be adopters 
to locate funds for setting up the program. In addition, this company 
concentrates on districts that are already users and need only replace 
their consumable materials. 

Handicapped by lack of capital, each of the publishers mounted low-budget 
advertising programs and skeletal sales forces. Thus, although the mater- 
ials were developed for the new drug education market, dissemination was 
conducted in a manner traditional in the instructional materials market. 
This has resulted in solid, although unspectacular, profits. 
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THE PRODUCT 



The Drug Decision Program attempts to give junior high school 
students an understanding of the proble^^^ connected with drug abuse. 
Designed for use in 19 class periods of minutes eacl>, the program 
prescribes a tight sequence of activities for teachers and students. 
For most classes, students complete programmed reading materials and 
then view and discuss accompanying films. Toward the end of the 
schedule, students spend two class periods playing a drug attack game 
to practice and demonstrate what they have learned about the medical 
and legal aspects of drugs. The final three days center around role 
playing activities, as students act out the story of an addict who is 
being considered for release from a rehabilitation center. With its 
programmed materials, films, and simulation gaming, the program makes 
the teacher more a manager than an information source. The developers 
perceived that most teachers would prefer this arrangement for the 
subject of drugs. 

DEVELOPMENT 

The Lockheed Corporation began development of the Drug Decision 
Program in 1963, a time when there was a rising national concern over 
increasing drug use by young people—and a time when federal spending 
for defense was starting to diminish. Believing that they faced a 
shrinking defense market, Lockheed P5anager(ient decided to explore the 
possibility of penetrating various civilian markets. They investigated 
concurrently a number of fields, obtaining small contracts for civic and 
government information systems, medical/health information systems, 
regional ecological information systems, and education. Management 
felt that tnere was profit to be made in these fields, as well as an 
opportunity to provide a social service. 

In entering the field of drug education, the Lockheed staff 
could look to their experience in several education programs. They had 
developed an electronic data processing program to upgrade reading and 
mathematics skills of pupils identified as potential dropouts in the 
San Francisco Unified School District. In conjunction with the San Jose 
Unified School District, they had completed an intermediate-school program 
for sharpening reading and mathematics skills through educational gaming 
and simulation. 

Starting in early 1968, Lockheed spent an intensive nine months 
developing the Drug Decision Program. Little was done Initially to 
involve school personnel in any formal way with the development of the 
materials. Staff believed that their task was simple: to supply school 
people with good, sound curriculum materials based on documented facts. 
It seemed that their materials could not help but be a success, and 
early reactions from the market supported this confidence. For example, 
a staff member visiting the annual American Association of School Adminis- 
trators convention phoned back jubilant about the reception of the early 
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prototype materials. 



In the fall of 1968 the first few units were released, and Lockheed 
encountered its first major stumbling block: the materials were not well 
received. Tiie lessons were too long and complex to be taught in the pre- 
scribed time blocks. The reading materials were repetitious and boring. 
An extravagant introductory multimedia presentation was a flop. The 
decision was ouicklv made to withdraw the materials and return to the 
drafting boards. This aborted release of the program had no visible 
Impact on its market potential, for only a few trial units had been re- 
leased. No other comprehensive drug education materials had reached 
the market at that time, so Lockheed still had the chance to make a 
contribution toward social change while reaping a sizeable profit. 

This time, development efforts were organized differently. Although 
they did not establish a formal development cycle with a schedule of 
testing and revision, the developers did involve school personnel in 
repeated testing of program components. Several Junior high school teach- 
ers in the local area, who had already struggled on their own to create 
drug curricula, reviewed the materials. Lockheed also secured the assist- 
ance of recognized experts in drug education to guide the presentation 
of Information. Deciding to include a game sequence in the materials, 
they hired a gaming expert to assist in development. This concentrated 
effort continued tnrough the spring and into the fall of 1969. During 
this time no marketing was undertaken, for they were hesitant to demon- 
strate the old materials that had been rejected, and there was nothing 
new to show. 



DIFFUSION 

Since the program's release in 1969, dissemination has rested in 
the hands of three different companies. In each case, the distribution 
effort was low-key because of limited resources for the education division. 
In tracing the dissemination efforts, it is interesting to note how each 
publisher approached the task. Lockheed Educational Systems was slow in 
starting its efforts and spent only about nine months in a formalized 
marketing program before selling the product. Technicon Education Systems used 
a low-costi traditional marketing approach and realized a substantial 
profit. Universal Research Systems, in assuming distribution rights, is 
concentrating their efforts on the best sales prospects: districts still 
uncommitted to any one program and districts that merely need replacements 
for consumables. 

Lockheed Educational Systems 

Lockheed Educational Systems handled dissemination from 1968 until 
the product was sold to Technicon in 1971. Although originally released 
In 1968, the product was not marketed until the fall of 1969, and efforts 
were really not initiated until 1970. Lockheed Educational Systems, a 
division of Lockheed Missile and Space Company, depended to some degree on 
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m^k«t?KJ'th/i;Sl*j2 '■'n''* ""'P'"'!'' "™ they InttUted 

?n Jh! SSJ?""*!"!! t^'y dtpendlnn on staff 

Staff members appeared on one program In the "Intej^fftro" <ftv»<ae 

in^"ocial o^^nblSS;'^2."J^ Teleyision'to^how thrfnvilS 'ofln try 
IS^ c S^J 1 » "° appear to have resul ted <i1 rectly f rom 

this nationwide exposure. Advance hyers explaining the Drub beOlslon 

2e^^presenteh^a^^^2^ 

i!7i5^^^f co"Pl^<>f "at^onal conventions, and an Information 

nates; helped Lockheed to hold group sales meetlnds to disruE? ahH hIcJiau 
2c fJ ''I^^S; Placement on stite ?hd d1stHc^ IJtbook -adop^^^^ 
Ind thl ^i^:^ ^5'°"''. the time necessary to ac?om? ish h s 
JhSclJ education materials Jould probably be pur- 

chased out of special funds rather than the budget for oSe currlcul^^^^^^^ 
area. Most of the sales effort centered on calls made to larae districts. 
Lockheed maintained sales offices in Silver Sr no Mar via nd?^r^^^ 
Illinois} Houston. Texas; and Mountain View, fflfe^^^^^^^ ^''^^^^^ 

the fwlt few"moJ?hf?n"?l7n "Vuu^'^i during the last months in 1969 and 
ine Tirst few months in 1970. This slow start demonstrated to manaaement 

l5 197o'''urShL5°hr*i'' ^^^^ the demand, does not Lll itself! IJte 
in 1970, Lockheed hired an educational marketer, and the product beaiin 

Sarj^ilSSt^frSSSidt*'^"^' ''^ "^^^^ Sky^'^rSSS^rLS^^J^lent 

Dv^n^JH ^^^T^l'^• Lockheed sold its interest in the Drug Decision 
Program to Technicon. Extended negotiations had been underway between 
Lockheed and Technicon for the sale of Lockheed's medical Information 
system, a propram that had evolved during the same period as the drua 
EfKiu^'^th"^ '"^'^'^^Q a number of civilian marke s siju?- 

liJf lol^hoo^'Jjn'?!! "t^ P^JJiarily enaaged in the medical field but, 
bla?1n? thliJ'nl!^ "^ ^^ ' '''"^ education program 

Technicon Education Systems 

1971 Ih^ImlS^fQ??"''^?? distribution of the drug program from May. 
\VrLl/A^ifr^^l^', Since many of the staff moved witt the program fi^om 
rSf *? Technicon. a disruptive chr^nge in personnel was averted. 
I;L^lf5S"**I^!l.P''T*^^59^" °" « l^f"^t^d basis because of fund 
1? fJrJl?*,M*/ direct mailing to superintendents of school districts in 

over 2,500 average daily attendance was conducted twice 
in lyl\tu\^^^t^^^'^ ^" ^^'2. Orientation wort^shops (primari y 
In the Bay Area) were conducted under county auspicei.to spread word 
Of the program's availability. Ads were pUced in a ^priety of educa- ' 



o 

ERIC 



163 



tlonal Journals. Three major conventions wore covered each year: the 
Association of Supervisors and Curriculum Developers, the American Asso- 
ciation of School Administrators, and the National School Boards Associa- 
tion. The product was reviewed bv the Anibrlcan Institutes for Research 
(for a Product Development Report ) and by Far West Laboratory for Educa- 
tional Research and Development (for Inclusion In the ALERT Sourcebook 
and In Drug Education .) 

Technlcon continued to face the problem that the product appeared 
to require face-to-face sales visits; advertising generated Interest, 
but follow-up contact proved essential for sales. Technlcon maintained 
four full-time salesmen (located In Chicago; New York; Houston; and Moun- 
tain View, California) and ten commissioned salesmen. These salesmen 
handled only Drug Decision for Technlcon. The local office answered all 
direct correspondence and then notified the field men of a district's 
interest. It was then up to the field men to Initiate and maintain con- 
tact through the sale. 

Almost all sales at that time, and at present, have been to school 
districts. Although Interest has been expressed by service organizations 
and local groups, these organizations have been giving funding support to 
districts rather than acting as purchasers. By 1971, there was a combina- 
tion of first-time sales and repeat sales of the consumable student work- 
book which must be secured for each participating student. Thus there is 
a constant yearly Income from districts coimiitted to using the program. 

Late in 1972, Technlcon decided to concentrate its capital and its 
management resources on its medical information system. Final sale of 
the program to Universal Research Systems was concluded in February 1973. 

Universal Research Systems 

The market approach of this firm is considerably different from that 
of its predecessors. Universal Research Systems, a developing company 
without much capital to work with, sees the program as a solid, low-effort 
moneymaker, an item that guarantees sales with little effort on the firm's 
part. This company has not revised the films but has done some updating 
of the print materials. 

Since the product has been actively on the market since 1969, a 
large percentage of school districts are already aware of its existence, 
and efforts to create general Interest can be dropped. Since Technlcon 
had already reserved space at NSBA and ASCO, URS staff covered these 
two conferences but do not plan attending any other conferences. They 
have only advertised in one educational magazine (which was new to the 
market). Instead, their approach is direct Interaction with districts. 
The sales force consists of two full-time salesmen, one on the east coast 
and one in the Sunnyvale, California area, along with fourteen salesmen 
who work on a static commission basis. Two of these men have backgrounds 
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In the audiovisual field, but the remainder are educators who sell 
Drug Decision only as a sideline* 

Much of their present business is in the sale of the consumables > 
but some new sales are made to districts where URS has taken an active 
role. A number of districts have been able to purchase the materials 
because URS has helped them to locate funding sources and write proposals 
for funds • Most of the federal funding comes from the On^nibus Crime Bill 
under the Justice Department's Law enforcement Assistance Administration. 
Funding under this program goes to the state, which distributes It to 
regional areas, which then award it to applicant districts, URS has also 
been successful in finding local foundations with funds available for 
such school programs* 

Training is provided free of charge to districts purchasing over 
$1,000 worth of materials, and approximately 15 to 30 percent of the 
districts using the program retrain each year in order to acquaint new 
teachers with the program. Since the training operation is not a money- 
maker, URS does not generally conduct the training itself, choosing 
instead to contract the work to teachers and administrators already 
familiar with the program. 



SALES FIGURES 

Unfortunately, sales records were not maintained in such a way as to 
allow us to track exactly how many Individual districts have been reached 
since active marketing began in 1969. A total of about 400 district5 
have placed orders, but some of these orders are for replacement of 
consumables. Best estimates are that about 250 different districts have 
been reached. 

Any school district with students in grades 6, 7, and 8^ is a target 
user for these materials. Nationwide there are approximately 16,515 
operating school districts, but, aware of the high costs involved in reach 
ing most of the districts, educational marketers limit their efforts. 
The present publisher indicated that informational mailings went to most 
of the 3,926 districts with average daily^attendance (ADA) of over 2,500, 
which collectively represent 80.6 percent of the school population/ 
However, Universal Research Systems' records also show sales to smaller 
districts. 



Mhe program is no longer marketed for 9th grade students. 

^National Center for Educational Statistics, 1972-73 Education Directory, 
Public School Systems . Table 1. 
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If we consider the target number of districts to be the 3,926 large 
districts, the program hc\«; reached 4.8 percent^. If we look at all 16,515 
districts as the market. It has reached less than two percent. 

More Important, however, is the question of how many students have 
been reached. First-time sales and sales of consumables show that ma- 
terials have been bought for approximately 400,000 students. {There 
Is no way to know how many students have actually used the program.) We 
can estimate that about 26,348,000 students have been enrolled in grades 
6 to 8 from the 1969-70 school year through the 1973-"/4 school year. 4 
Again, we could use either of two target figures, the 81 percent of stu- 
dents enrolled in the large districts that received the most attention 
(or about 21.342,000 students), or the total 26,348,000. In either case, 
we reach the conclusion that the Drug Decision Program has reached almost 
two percent of its target population. 

In the ten months since URS acquired control over the materials, 
130 separate agencies have bought materials. Of these, 96 (73.8 per- 
cent) were school districts, while 17 (13.1 percent) were individual 
schools. Two states and six county offices also secured the materials, 
and there were nine other agencies (primarily private schools). 

It was possible to obtain enrollment figures for 109 of the sites. 
Of these, 66 percent were districts between 2,500 and 24,999 ADA; 10 
percent (a total of 11 districts) were over 25,000 ADA, and not surpris- 
ingly this group proved the strongest market. It is interesting to note, 
however, that 23.8 percent were under 2,500 ADA. Still, from a marketing 
standpoint, the amount of revenue generated by small districts is not high 
enough to warrant any special marketing attention. 

Sales for Universal Research Systems come from 34 of the states and 
from Canada. The strongest showing of sales is in the Midwest, with 47 
(or 36.1 percent) of their sales. The Midwest is followed by the 
eastern states (21.5 percent of the sales), the northwestern and western 
states (14.6 percent), and then the southern (12.3 percent) and south- 
western states (4.2 percent). Illinois led the states in number of sales 
(14 locations) with Iowa next (11 locations), and then New York, Texas, 
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''Of the 109 districts for which we could secure ADA figures, 76 percent were 
over 2,500 ADA. Thus we assumed that approximately 190 (or .76 x 250) 
of the districts purchasing materials would be over 2,500. 

^National Center of Educational Statistics, Digest of Educational Statistics^ 
1972 Edition . Table 28. Our total figure was found by adding together 
the enrollment figures for 1969-70 for grades 6, 7, and 8i the enrollment 
figures for the sixth grade for 1970-71 and 1971-72; and a projected sixth 
O grade enrollment figure of 3,791,000 for 1972-73 and 1973-74. 
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and California, all with ten 1 ©editions each. The first two publishing 
companies both maintained sales offices in Illinois and New York, thus 
probably accounting in part for the high number of sales in the Midwest 
and New York. The Texas sales appear to be due to "foot in the door" 
success, whereby sales in one district prompted other neighboring districts 
to acquire the materials. California, being the home office for all three 
publishers, should naturally account for a significant portion of the 
sales. 

The following Sales chart shows a slow start and a rapid peak fol- 
lowed by a slow descent. 
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With the exception of the slow start, which 1s easily explained by 
the lack of marketing effort, the sales figures follow closely the na- 
tional trends in drug education curricula. By 1971, school districts 
were past their first "panic" and had reached a stage where more careful 
planning was conducted. Thus, at this time, more districts started to 
turn toward developing their own programs, utilizing materials drawn from 
already existing programs but not depending solely on these programs. 
High-interest areas outside the traditional curriculum, such as sex 
education or drug education, have been shown in the past to have a short 
market span. Demand for comprehensive, prepared materials in such areas 
is short -lived. 
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available figures reveal the breakdown of the drug educational ma- 
terials market. There are a number of similar programs that advertise 
themselves as comprehensive programs and a multitude of print and AV sup- 
plementary mater als. There is also direct. competition from districts 
that develop their own materials. But if we look at the total instruc- 
tional materials sales for the elementary-high school field, individual 
shares of the market range from 3.5 percent to 7.4 percent. 5 when we 
cons der that the three publishers of the Drug Decision Program have col- 
o cSo A^^f succeeded in reaching 4.8 percent of the school districts over 
<J,5U0 ADA, then it appears they have been moderately successful. 

DISCUSSION 

Product Design 

In retrospect, the Drug Decision Program represents the kind of drug 
education materials the public once thought were needed in school systems. 

nL; kJ^I^"" !>?^u^^^'^ Kl^^^ originally intended, the market almost 
undoubtedly would have grabbed at it. Drug Decision would have been the 
only curriculum program available when public concern over drug education 
w^« high, knowledge was low, and requirements were vague. The schools 
were willing to accept the responsibility for educating the students, but 
they wanted the materials, not the teacher, to bear the primary responsi- 
llu teachers were uninformed about drugs and were afraid to deal 

with the subject area. Lockheed's materials placed the teacher in a man- 
agement role, with the materials carrying the burden of the instruction. 

Because Lockheed did not expect conditions to change, they did not 
build into the materials a flexibility that would have allowed a school 
district to adapt them to changing instructional needs. With this prob- 
lem, and lacking the func's to revise the materials extensively, Lockheed 
and the subsequent publishers were locked into a financial commitment to 
a product that could not change as public sentiment changed. But public 
sentiment has been changing. Rather than selecting a purely information- 
al, fact-oriented program, districts have started to turn their attention 
toward the social causes behind drug use by students. There continues to 
be a growing acknowledgment that a drug education program should contain 
more than a presentation of facts. Where does that leave the Drug Decision 
Program, a highly structured, primarily factual product? 

The Inclusion of the Drug Attack Game and the role playing in the 
last days of the course provides activities more in line with the ones 



^Sigel. E.. The El-Hi Market 1971; Where It's Heading . White Plains, 
New York: knowledge Industry Publications, 1971. 
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that schools are becoming interested In, The Introduction of the concept 
of disaster management also sets this program apart from pharmaceutical 
fact programs. Nevertheless, with its tight structure and emphasis on 
facts, the program does not help those toachers who want their classes to 
concentrate on larger social issues. 

Even in 1968, problems were apparent in the materials. They re- 
quired 19 class periods (45 minutes each) for the entire course, and the 
materials were so carefully sequenced as to prevent easy adaptation. For 
a class such as social studies that meets four times a week, this would 
m,\n almost five weeks of a semester devoted to this one topic. This 
places a heavy burden on any one department which has other materials to 
cover. The student and teacher manuals were large and cumbersome. The 
vocabulary level was originally above that of many 6th- to 8th-grdde 
children (although subsequent revisions have modified the vocabulary). 
Ihe films posed problems because there were so many of them; schools had 
u . )" distributing and keeping track of them, and the publisher 

had difficulty in maintaining sufficient stock to supply rentals. 

The program appealed to some because it attempted to provide a 
complete curriculum, but others objected to the fact that it allowed 
little room for input from a school system. 

The program costs have fluctuated slightly with different publish- 
ers but have run as high as $4-5 per student. Costs are reduced as more 
students are involved. It would seem that the high cost of this program 
would have had some effect on sales. The present publisher, however, per- 
ceives his competition to be locally developed programs rather than other 
coimiercial programs. 

Field Testing 

In the early stages of development in 1968, almost no field test- 
ing was conducted. The next year, however, testing was done in California 
and Rhode Island. Some of the tests took place on an informal basis with 
local teachers acting as consultants, while other tests were more exten- 
sive. Testing was not used as a tool to market the materials. Although 
Rhode Island schools bought the materials and agreed to participate in 
the testing, they did not extend their use past the trial period in more 
than a few places. None of the participating California school districts 
purchased the materials. 



Dissemination 

All of the three publishers have employed slightly different tech- 
niques dictated by the age of the materials, changes in the market, and 
their own situations. Lockheed's sales efforts were minimal until an 
educational marketer was hired nine months before the program was sold to 
Technicon. Marketing was hampered because of limited funds at both Lock- 
heed and Technicon. The staff cooperated with any outside organization 
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that evaluated the program, advertised In frequeiitly-consulted educational 
magazines, attended and set up displays at the largest national educational 
conferences, and conducted mailings to superintendents in the largest 
school districts. There was no federal money available to them for demon- 
stration projects or for the establishment of linking agents. They concen- 
trated their resources on the cheapest mass advertising available and used 
their sales force to visit the largest school districts where there was 
t\e potential for the biggest payoff. Few sales have come through the 
mails; most required personal interaction with the buyers. The selling 
job was somewh^^t complex, for educators were uncertain of how to proceed 
in the area of drug education. 

Universal Research Systems has centered its resources on wooing large 
districts that are still uncommitted to any one program. Feeling that 
most educators are aware of the need for a special drug education effort, 
and figuring that most have heard about the Lockheed materials, the URS 
staff concentrated their efforts on legwork. They are prepared to assist 
a school district in locating and securing foundation or federal support 
for buying their materials. This kind of direct interaction has paid off 
not only in initial sales but also in repeat sales of the consumable items. 

From the publisher's standpoint, repeat sales are inexpensive; costs 
are merely Incurred in office processing work such as packaging and ship- 
^ping. Approximately 90 percent of their sales now are follow-up sales 
which require little attention from staff. Because demand for comprehen- 
sive programs has dropped, income comes primarily from the consumables 
sold to districcs that adopted the program In the past. 

Training 

Euch of the publishers has offered free training to districts that 
purchase $1,000 worth of materials. For others, training costs run about 
$200. The primary intent of the training has been to fdmiliarize teachers 
with the course materials, not to help them to expand the course content. 
The present publisher contracts the training out to teachers and administra- 
tors skilled 1n using the materials. The training Is not set up to make 
money for the publishers, nor was it started as a mechanism for drawing 
more sales. However, the continued provision of training does act as an 
incentive to a school district to continue with the course, to train enter- 
ing teachers, and to re-order copies of the consumable student workbook, 
since it is far easier for a district to continue an old program than to 
initiate a new one. 
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TECHNOLOGY FOR CHILDREN (T4C) 




PROGRAM SUMMARY 



ppoduot name: Technology for Children {T4C) 

Developer: Division of Vocational Education, New Je':sey State Department 
of Education, Trenton, New Jersey 

DiBtHbutov: Same 

DesoHpticn: Technoloqy for Children is a K-6 child-centered proqram 
which couples "hands-on" career education activities with traditional 
element^v^y school academic subjects. Although developers contend that 
the program can be used In any type of classroom, \t is best suited 
for and tends to foster an open classroom atmosphere. Participating 
teachers are required to attend a three-day workshop and encouraged to 
take a 15-week optional college course. Materials developed by the 
project staff consist of 47 lesson plans or "Episodes," covering ac- 
tivities such as the construction of a miniature house, production of 
a TV program, and planning of a space flight. A projected 310 "Good 
Idea Cards" suggest activities that may be used separately or in con- 
Junction with the "Episodes." One such card explains how to get sound 
from a record using a pin and a milk carton, another encourages child- 
ren to explore the concept "electricity makes heat." The staff has 
also put together 56 learning centers; te&chers may purchase complete 
kits or components from companies listed in T4C publications. Teachers 
are not required to purchase any materials and are encouraged to de- 
velop their own learning centers* 

Target market: Materials have been developed for K-6 students. T4C 
Supervisors {geherallv principals, curriculum coordinators, and teach- 
ers with release time; are the target buyers. Top-level district ad- 
ministrators approve requests for matching funds and release time for 
teachers participating in the program. 

Coet: For each teacher who participates in the program, a district is 
given $300 by the state to be matched with $300 from its own funds. 
Some districts provide the entire $600 without state support. Districts 
may use part of that amount to cover the $20 per teacher cost of the 
three-day workshop, the $30 cost of the three-unit college course, or 
the cost of teacher release time. Teachers are free to purchase ma- 
terials with the remaining money. 

Episodes cost $.50 each for out-of-state purchasers, $.30 in New 
Jersey. Good Idea Cards are not yet available; estimates are that 
they will be sold for about $10 per 200-card packet. Learning centers, 
available through outside companies, generally cost about $50. 

Evaluation: Evaluative data on T4C are inconclusive because of the dif- 
ficulty of designing instruments to measure effects of this type of pro- 
gram. A 1969 study conducted by a member of the project staff, 
involving children who had been in a T4C classroom for two semesters 
or less, Indicated that out of 29 sets of paired experimental and con- 
trol achievement test scores, 27 failed to show a significant differ- 
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ence. (Developers note that for a statistical difference, a child would 
have to have improved two and one-half grade levels.) However, "in the 
normal I.Q. group, more children in the experimental group out-perfOrmed 
their counterparts in the control group, while the reverse is true with 
the high I.Q. group." The report questions the validity of basing an 
evaluation of the project on achievement test scores which may not be 
true measures of student learning*, it concludes that more in-depth studies 
are needed to determine the value of T4C. 

A further study covering the period from February 1 through June 30, 
1971, conducted by an outside evaluator, suggests that pupils In T4C 
show slight gains In reading, vocabulary, and occupational cognizance 
tests. ''Attendance records showed some gain as compared with that of 
the previous year, but the records were not conclusive, disciplinary 
problems were reported to be lessened, and teachers felt that their 
students had made progress 1n the areas of attendance. Interest level, 
work effort, ability to work with others, and their self-concept; 
parents were generally in favor of the project." 

Current status: Can be adopted by contacting developer. 

Innovative ef feats: The basic element of T4C is Staff training that 
shows teachers how to implement a career education program in combi- 
nation with traditional academic subjects. Although the program may 
bfi implemented to varying degrees in any tyfe of class, its emphasis 
on concrete experiences tends to promote an open classroom atmosphere. 
Developers realize that teachers will accept the program at different 
paces, and they encourage a gradual transition to openness. T4C 
also changes traditional budgeting patterns, since financial support 
is provided by the state department of education and matched by 
school districts. Teachers use district and state funds to purchase 
items they feel may be useful 1n program Implementation. The four 
teams require that administrators, teachers, and the community co- 
operate in implementation of the program. Full implementatioti thus 
changes teaching methods, budgeting patterns, and traditionaV roles 
within adopting districts. 

Synopsis of diffusion: Over several years, this product and thp dif- 
fusion strategy accoii'panying it have taken on many different forms. 
Currently, the staff employs a combination of financial Incentives 
for adopters, training for teachers, and involvement of administra- 
tors. Previous approaches that were- abandoned included providing 
training alone, without materials, and providing a rather elaborate 
set of materials. In the first case teachers had trouble with imple- 
mentation, and in the second case the package proved unpopular. A 
middle ground has now boen reached, where some optional materials 
developed by the T4C staff can be used, and teachers can use the cash 
stipend to supply whatever else they need. In many ways, users take 
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ah active part in putting together this program. Individual teachers 
may purchase whatever materials they feel tney need; school staffs 
work together to establish the needed support systems; the optional 
materials created for the program were designed with the participation 
of teachers and administrators. 

The stipend of $300 for each teacher usina the program Is granted to 
districts for the first year of use, and It must be matched from 
district funds. This plan gives teachers the resources they need to 
put together a program. By requiring a matching commitment from thfc 
district, the plan also encourages administrative support. 

The program includes teacher training through a three-day workshop; 
teachers may also participate In a 15-week course for university credit. 
In some cases the entire faculty of a school. Including the princi- 
pal, has been trained, and the project staff believe this hi\s been an 
effective tactic. A system for implementation involves the creation 
of four "teams" of administrators, teachers, and interested cotfimynity 
people. Under this plan, each team undertakes one of the aspects of 
implementation— management, staff training, curriculum, and outside- 
scnool resources. 
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THE PROGRAM 



In 1966> armed with state and federal funds augmented by a Ford 
Foundation v^r^nt, a staff of six 1n the Division of Vocational Educa- 
tion of the New Jersey State Department of Education began developing 
a kindergarten through grade six program they called Technology for 
Children. They knew that It would be difficult to convince teachers 
whose days were already filled with language arts, social studies, math, 
and science that yet another subject, career education, should be added 
to the curriculum, Instead they chose to develop a program that would 
combine experiences In technology with the study of traditional aca- 
demic subjects. However, because the program Is experience-based, the 
developers are asking even more effort of the teachers than that re- 
quired by the addition of a new textbook. The new curriculum requires 
that students spend time away from their desks and become actively In- 
volved in their own learning. For some teachers who choose to fully im- 
plement the program, this neans a total change In their style of teaching, 

Optimally, developers see T4C as an Integral part of the entire 
academic program. For example, construction of a log cabin by fourth- 
graders or a 24-hour stay Inside a model space capsule they have construc- 
ted may be a valuable lesson In math, social studies, science, reading, 
and the world of work. Because the T4C program encourages teachers and 
students to explore many types of activities In different ways, the pro- 
gram works best In an open classroom. However, the program which was 
developed Is extremely flexiblei It consists neither of set materials 
nor of a single teaching method, and it can exist in many forms. The 
only requirement Is that participating teachers attend a workshop which 
offers training In Individualized Instruction, the use of learning centers, 
and the safe use of carpentry tools. Since teachers are free to imple- 
ment the program gradually, to use it as much or as little as they feel 
is necessary, and to use a wide range of materials and methods, the pro- 
gram Is compatible with traditional teaching methods. The only class- 
rcoa evidence of T4C may be one or two learning centers or a class pro- 
ject to make rock candy in conjunction with a unit on crystallization. 

Although it is also possible to use T4C in a departmentalized school, 
this is difficult because the very nature of T4C stresses the Intimate 
relationship which all subjects share with the world of technology. 



The format of this product has remained unusually flexible; as adop- 
tion or implementation difficulties became apparent, basic changes were 
made in its design. Never a tightly structured package, it has' included 
v arying amounts and kinds of materials, training,- and built-in incen- 
tives. 

Tie director of the program during its infancy wanted a small, 
tiaht, highly polished program. Realizing that implementation of 
T4C would be a gradual process that could best be undertaken 
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in small steps, she chose to segment the market and concentrate first 

on suburban schools. This strategy offered another advantages In the 

suburbs, the program would not be labelled as one that proposed locking 
children of low-Income families Into set occupations. 

At first, T4C consisted primarily of six-week summer training work- 
shops for teachers, where basic Ideas and techniques were Imparted. For 
example, teachers were encouraaed to Incorporate Individual Pupil Logs 
Into the curriculum. Like children In British Infant schools, pupils . 
are expected to record plans, expectations, and achievements In these 
booklets. Teachers also write In the books; T4C staff note that booklets 
encourage Individualized Instruction since they are used by the teacher 
to report on the activities of each child. 

For a time the program provided a package of carpentry tools for 
classrooms. This package was later dropped, to be replaced by a grant 
for the purchase of any materials chosen by the teacher with research 
help available from the T4C staff. 

In June, 1969, 47 instructional units were prepared by the staff 
in cooperation with teachers and administrators throughout the state. 
These ''Episodes," as they are called, provide suggestions for the intro- 
duction of technological activities. Each Episode is directed towards a 
specific curriculum area, but as teachers used the units, It became ap- 
parent that each actually covers a number of areas. Teachers are not 
required to purchase the Episodes, and T4C teachers tend to use them 
more as a source of Ideas than as set lesson plans. 

Technology for Children has never pretended to be a packaged pro- 
duct that can be moved effortlessly into a classroom. Those materials 
that have been developed have grown with the program and do not purport 
to be a total solution to all classroom problems; they require extensive 
input from the teachers. Several small firms like The Learning Tree 
market learning center materials and offer T4C training. Although large 
publishers have expressed interest in marketing T4C, the Department is 
not interested In a commercial publisher. "They're always telling us 
what we need, and how we should package the product; how do they know 
what we need?" the associate director asks. 

Although a number of attempts have been made to evaluate the success 
of T4C, the developers contend thai there are no reliable instruments to 
measure Its actual impact. The first evaluative report on the project 
was published in 1967. Because research was conducted during the first 
year of the project, developers assort that tl»e data are outdated and 
irrelevant; the 20 teachers surveyed had few supplies and little admin- 
istrative support. 

In 1969 a member of the project staff assessed the project to deter- 
mine whether the program achieved its goal of providing "for enhanced 
learning in math, science, social studies, and language arts." Or. Koo 
used 29 pairs of pre- and post-standardized achievement test scores for 
matched experimental and control groups who were chosen on the basis of 
sex and I.Q. scores. Teachers of the two groups were also matched for 
similar teaching ability and methods. Only two of the 29 sets of paired 

178 



scores showed significant differences, and these were negatively cor- 
related. Th'^t ISs those "children who had Instruction in T4C performed 
poorer than those without T4C." One Interesting finding was that "In 
the normal I.Q. group more children In the experimental group out- 
performed their counter parts In the control group, while the reverse 
Is true with the high I.Q. group." He notes that achievement scores 
which measure abstract concepts might not be an appropriate measure of 
skills taught 1n the T4C program, and that If stress Is going to be placed 
on learning traditional subject areas, T4C materials should be matched to 
textbook materials. This evaluator also emphasizes that the experimental 
group students had beer Involved In T4C no longer than two semesters and 
that a long-range study might produce different results. He concludes 
that a more accurate statement about T4C might be, "T4C enhances the 
learning process." 

A 1971 study conducted by an evaluator from Rutgers University re- 
ports '-.hat "pupils In Technology for Children showed gains In reading, 
vocabulary, and occupational cognizance, although, as anticipated, the 
gains were slight." She noted that "Teachers felt that their students 
had made progress In the areas of attendance, Interest level, work effort, 
ability to work with others, and their self-concept." 

This program did not go through a research and development cycle with 
a schedule of field testing and revision. Its history does show a number 
of basic changes 1n format, but the changes did not arise out of extensive 
data from trials with potential users. The developers, many of them 
former teachers, had Informally assessed the market and were in constant 
touch with users, so revision of materials grew automatically with the pro- 
duct. In the early days of T4C, the small team filled several roles- 
developers, disseminators, and consultants for users. As they taught 
teachers how to use the program and assisted in the classroom implefrien- 
tation, feedback from teachers and students led to cnanges in the program. 



DIFFUSION 

In all its formats, this product has been more than a simple career 
education program. The T4C staff know that its approach could be threat- 
ening to some teachers and that while they had to work within the system 
of existing schools, they would be working to cause real changes in that 
system. How did they go about getting teachers and administrators to 
accept the changes? 

The evolving diffusion strategy for Technology for Children can 
be seen as a response to three questions: What Incentive is there for 
anyone to adopt a program on "technology?" How can teachers use this 
new approach effectively? Won't administrators be indifferent or hos- 
tile? Implicitly, the T4C staff has answered these questions: money is 
a strong incentive; teachers can be trained; principals can be encouraged 
to participate In implementation. ,They have acted on the first tv/o 
statements from the beginning and more recently have begun to apply the 
third. 
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A large portion of the project funds has been used for the dif- 
fusion of T4C. The associate director of the project estimates that 
20 percent of the total budget, or about $50,000 a year excluding sala- 
ries, has been spent on dissemination. In the first year of the project 
they spent $12,000 for a 17-m1nute sound color film which was produced 
for them by a New York firm. This film, which explains how T4C works and. 
how children learn, was shown to PTA's, administrators, and teachers, 

In order to assist teachers in bringing technological activities 
into their classrooms and to teach them how to integrate small kernels 
of career education activities into other learning experiences, the team 
initially used a large share of its budget to sponsor six-week summer 
training institutes for elementary classroom teachers. Not only was the 
training free to the small group of teachers who attended the first ses- 
sions, but they were also provided with a weekly stipend of $60 to $90. 
By the second year, 1967, 33 teachers had attended these workshops. 
Where they had learned how to work with tools and had practiced T4C with 
children in four demonstration classrooms. 

Certainly money was a powerful incentive to encourage teachers to 
attend these sessions. The training seemed effective, and a member of 
T4C visited classrooms to assist in implementation, answer questions, and 
provide encouragement. But what happened when the teachers had l?ft the 
demonstration center and were on their own? What about the materials 
needed to Implement these programs? 

In 1968 the present program director. Dr. Fred Dreves, Joined the 
project and attempted to solve the problem of lack of me(ter1alsi every 
teacher attending the summer workshop was given a mobile tool center for 
his classroom. Including a wealth of tools from soldering kits to power 
saws, the center was valued at $700. This incentive encouraged teachers 
to put a part of the day aside for concrete career education activities, 
creating an atmosphere for open education. The project, however, en- 
countered some criticism for this move. Parents unaccustomed to career 
or open education accused the project of tracking their children into 
trades areas. Explanations that technological education is important for 
every child and that T4C was used to help teach traditional subjects as 
well as career education were met with rebuffs. Parents suggested that 
it was easier to teach language arts with books, puppets, or plays than 
with a harmier. 

Aware that this criticism was hindering acceptance of the program, 
and that parents and some teachers were correct in suggesting that many 
different paths might lead to the objectives of career education and open 
education, the project staff decided on a different tactic. Instead of 
a tool center, teachers would receive money to purchase whatever kinds 
of materials they felt would assist them in teaching technology. If 
they chose to purchase the tools, that would be fine, but every teacher 
would be allowed to make h!s own selection of materials from the whole 
world of technology. 
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When Dr. Dreves Joined the staff he started a new diffusion 
strategy. According to the assistant director* Dreves felt that the 
staff was trying too hard to sell the program to all teachers. He sug- 
gested that they concentrate their efforts on those teachers most 
likely to Implement T4C, The staff followed his advice, attempting 
to find those select teachers by talking with administrators and tea- 
chers themselves. Coupled with publicity from teachers who had been 
through training, the strategy was successful. In 1968-69 there were 
56 participating teachers i by the next year the number of paifM;1c1 pants 
had more than doubled. 

But because more teachers were becoming Interested, the cost of 
training was Increasing. In 1969, since sunmer institutes were proving 
to be too costly, three-day release-time workshops were held at the 
T4C annex in Florence, New Jersey. The assistant director of the pro- 
gram says that the six-week sessions were unnecessarily long, and one- 
or two-week workshops would have been best. But a lack of funds pro- 
hibited sessions that were longer than three days. Although staff 
members continued to assist teachers at their request, the concentrated 
15-week program of in-classroom aid was dropped. Since it was likely 
that some teachers would want training beyond the three-day workshop, 
the project staff decided to Implement a 15-week graduate credit course 
in cooperation with Trenton State College. The cost of the course was 
underwritten by the state so that teachers were charged a nominal fee 
of about $30 for the training. Instructors were drawn from the staff 
^nd seasoned T4C teachers. 

Up to this point, actual materials for the T4C program were scant. 
The $700 package of tools had been replaced with direct grants for the 
teacher to purchase his own selection of materials. The T4C staff re- 
searched available products and gave teachers some information on possible 
choices. In June, 1969, the staff joined forces with teachers and ad- 
ministrators to produce "Episodes." 

Each Episode includes a list of suggested activities in addition to 
instructions on how. to build something related to the unit. For example, 
the unit, "Electricity at Work" explains how to assemble a door bell, a 
telegraph, and a lamp circuit and suggests that students install a door bell 
on a doll house, learn Morse code, and construct a lighting circuit com- 
plete with miniature telephone poles. Another Episode entitled "Model 
Stagecraft" encourages teachers and students to read and write plays, 
visit a community playhouse, draw plans for a small stage, present a play 
complete with "actors ," costumes, lighting, and sound effects, and finally 
to design a full-size stage set for a live production. 

The staff was discovering that even though the teachers had re- 
ceived training and materials, the lack of administrative support for the 
program was keeping it from being fully Implemented In some districts. 
They considered that one way to increase this support was to require that 
districts match state funds for teacher training. This tactic seemed 
reasonable; if a teacher were Interested in implementing T4C, he would 
have to go through the school district to get administrators to approve 
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$300 for his training and materials. The teacher would thus have the 
sanction of administrators, and they would have a vested Interest in' 
preserving and augmenting the program. And the T4C staff could use 
the extra' funds for training additional teachers. 

In 1970 the project made further moves to tie administrators Into 
the T4C program. The Total Commitment System began by Including ad- 
ministrators In training through an Education Professions Development 
Act grant In cooperation with USOE. These administrators, generally 
principals, became "T4C Supervisors" and were urged to cooperate with a 
small group of teachers 1n a T4C unit. According to the project direc- 
tor, "The T4C Supervisor afforded the group with the administrative sanc- 
tion necessary to effect the changes. Old requirements that stifle In- 
novation practices must be relaxed and teachers encouraged to unstruc- 
ture the classroom learning environment." 

In October, 1970 New Jersey's governor signed is bill implementing 
career edufiatlon In three cities, enabling T4C staff to train the entire 
faculties of three pilot schools. This was viewed as a successful means 
of dissemination, and funding was renewed for a second year. In five- 
week workshops, held during the summer, the principal and all teachers 
Were assisted In initiating T4C with some of the children. This tactic 
seemed a good one to make an Immediate Impact In New Jersey's urban 
areas. 

The staff felt that they were now on the right track. They were 
beginning to see administrators working effectively with teachers to pro-^ 
mote the Implementation of T4C and restructuring of entire schools. This 
pattern of cooperation became more formalized a year after the first ad- 
ministrators had been trained. In 1971 a few schools, at the suggestion 
of the T4C project staff, began organizing three teams of both teachers 
and administrators and one team of outside resource people. There Is 
no set structure for teams, but In most schools the various teams accom- 
plish the same objectives. In general, Team One. the administrative team, 
Is composed of the local T4C supervisor (usually the principal), high- 
level administrators, and interested classroom teachers. It is the duty 
of this team to provide overall leadership for local T4C implementation, 
to arrange for teacher release time, to provide money for classroom ex- 
penditures, to serve as a public relations group, and to evaluate the 
success of the program. 

Team Two, the teacher training team, is composed of the T4C super- 
visor and other district staff who are interested in planning for and 
Implementing inservice training programs, keeping teachers and admlnis- 
trators aware of relevant college or outside programs, and developing and 
maintaining a file on training help available from outside people. 

Team Three, the curriculum team, "exists to provide a source of ideas 
for classroom implementation." It shares new ideas within the school, 
district, and state. Members of the team include the supervisor and in- 
terested teachers. Teams One, Two, and Three meet regularly; teachers are 
given release time to participate on these teams whenever possible. 



182 



Team Four Is composed of Individuals, organizations, or agencies 
outside of the school that assist In the Implerfientatlon of the program. 
They may be vendors, hobbyists, professional persons, artisans, busi- 
ness people, high school students, or retired persons. 

Having developed the program and Its Implementation mechanisms to 
this point, the staff members in the T4C office have been able to let 
others handle Implementation while they concentrate on publicizing; the 
program. Because the program Is now so widespread, they have found 
that they have little time to venture Into the field, and so most train- 
ing Is done by a network of T4C supervisors and those teachers who are 
experienced with the program. As a publicity device, the associate 
director says that he sends out a cryptic yearly mailing to all princi- 
pals. "The mailing Is a very brief description of the project j Just 
enough so they will be curious," he sjxys. Interested administrators call, 
and say, "I can't make heads nor tails out of your letter," The associ- 
ate director says that Is exactly what he wants, because then he can 
start talking to them seriously. He adds, "And we talk, and talk, and 
talk to supervisors, elementary coordinators, to large and small groups." 

Frequently a teacher becomes Interested in the project and calls 
the Department, The assistant director says, "we listen and then ask that 
the teacher get In touch with the supervisor and ask him to call the pro- 
ject." Once the administrator calls, a member of the staff visits the 
school or district to explain two points: first, that T4C entails a lot 
of work, and second, that while the state funds the project for one year, 
continued funding must come from the district. In this way, the project 
is assured of teacher and administrator support before training begins. 



SALES FIGURES 

Although developers are aware that not all teachers are interested 
in fully implementing the type of program which T4C represents, the pro- 
ject has set its sights at reaching nearly all of the state's 32,000 
elementary teachers by 1980. In late-1973, 2,000 teachers had received 
training, representing just over six percent of the total audience. 
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Considering that this is a product that involves both time-consuming 
training and a financial contribution, and one that does not represent a 
traditional subject ayea, the record is impressive. 

According to the Department of Vocational Education, the program 
has had astonishing success. The staff enthusiastically points to several 
measures of this success--in 1969 ths Ford Foundation renewed funding with 
the second three-year grant for $303,460 » and in January, 1970 the pro- 
gram received a medal of achievement award from the Aerospace Education 
Association. The program was one of nine winners selected at a conference 
where a live demonstration of the project was viewed by visitors from all 
over the United States. Another indication of the program's success is 
the large number of teachers who have expressed interest in the project. 
Since there Is not enough room in the planned workshops during 1973 to 
accomnodate all interested teachers', many are taking the longer college 
course in lieu of the workshop. For the fall, 1973 semester, 24 college 
classes in T4C were offered. 

Members of the project staff know that not all teachers will accept 
T4C. The assistant director explains that some traditional teachers are 
doing a good Job and would not be helped by T4C training. Others, he says 
won t buy it because, "it isn't easy.'' However, there are teachers and * 
administrators who see T4C working and see children with a renewed interest 
In school, and these enthusiastic users are good sales people for the project. 

With the increasing success of T4C in New Jersey, 1t has begun to 
seep over the borders. Members of the staff occasionally conduct train- 
ing sessions or attend national conventions on their own time to publicize 
T4C. According to project staff, in those areas of the country where the 
necessary requirements of funding, administrative support, and program 
flexibility are maintained, the project has been successfully Implemented, 



DISCUSSION 

Product Design 

Technology for Children has not depended on a set of glossy or boxed 
materials. Developers were aware from the beginning that such materials 
would be antithetical to the type of program they were trying to foster; 
while asking teachers to be flexible in their teaching they could not 
force them to purchase a set of highly-structured {materials. Instead of 
developing expensive learning centers, the developers researched available 
products and suggested that teachers contact the individual companies iv 
they were interested in buying materials for learning centers. The few 
materials that have been developed were added slowly. They were written 
cooperatively with teachers, and their purchase was not demanded as a part 
of the program. During product development, som elements were subtracted 
or significantly altered when they met with user opposition. 
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T4C stands In contrast to the many products that appeared on the 
market as complex, complete packages. The apparent success of Its ap- 
proach supports our contention that for sons*) products, It may be better 
not to pretend that a process or Idea can be packaged. In the case of 
T4C, developers viewed training and flexibility as the important aspects 
of the program and used their grants both to provide the training and 
to give teachers money to buy whatever things they found important for 
implementation. ■ 

Testing 

Unlike most of the other products covered in this book, the T4C 
program did not go through a research and developttient cycle. Revisions 
were based on informal feedback which the developers gathered while 
working in the field. The lack of field test data does not seem to 
have hampered the proaram's adoption or implementationi this supports 
our observation that field test data is frequently irrelevant to users' 
acceptance of a product. 

Dissemination Efforts 

Because the project was developed and distributed by the same 
small group of people, many problems of other productj were avoided, It 
was not necessary to find a publisher or provide incentives to salesmen 
to Market T4C; the staff was totally conmitted to the development and 
dissemination of one product. 

Incentives have been provided for users, though; one key factor in 
the dissemination of T4C has been the money given to teachers who parti- 
cipate. An offer of free training may perk up ears that are otherwise 
closed to new ideas . 

Still, there have been people who arfi not Interested or excited by 
the T4C concept. For some it represents the wrong philosophy of educa- 
tion; for others it is too much work. Awaj-e that they could not reach all 
teachers in New Jersey, in the third year of the project the staff began 
searching for the pockets of educators who were most interested in their 
product. Through presentations and talks with teachers, they found those 
segments of j;he population who were most interested in the type of train- 
ing that T4C provides. 

Training anjL Implementation Assistance 

T4C differed from other products in that developers were aware from 
the start that t kilning was a key factor in the success of the program. 
They concentrated on providing teachers with the training at no expense. 
In addition, Implementation assistance has always been provided to those 
teachers who request it, and the project encourages necessary administra- 
tive support for growth and change. 
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NEW SCHOOL OF BEHAVIORAL STUDIES IN EOUCATIOM 

By 

Kathleen Oevaney 




PROGRAM SUMMARY 



Progvm nmet New School of Behavioral Studies In Education 
Der)6lop6V} University of North Dakota 

DesoHpUon: This proaratn lasted from 1968 to 1972, as a planned strategy 
for gradually Individualizing and itwdernlzing the curriculum and organ- . 
Ization of North Dakota elementary schools by upgrading the education 
of the state's practicing teachers. The New School existed as an 
alternative mode of teacher education separate from the University's 
College of Education. It was designed to enable practlclna North 
Dakota elementary teachers who possessed only two-year* college degrees 
to Complete liberal arts baccalaureate degrees. At the same time, 
master's degree candidates replaced practicing teachers and Introduced 
new methods for individualizing instr'uction and modernizing curriculum 
Into North Dakota elementary classrooms. New School also enr^olled pro- 
spective teachers. 

The New School was characterized by the following: 

" Faculty drawn from education and liberal arts disciplines. 

Mixed enrollment of young prospective teachers, older and 
experienced "less-than-degree" teachers, and graduate 
students {master's and doctor's). 

Master's degree Internship program placing fully-certificated 
Interns in the classrooms of the "less-than-degree" teachers 
while the latter returned to college full time. 

" Nonprescrlptlve college curriculum which allowed the under- 
graduate student to design his/her own Individualized 
academic program and to evaluate progress with close help 
of a faculty advisor. 

° Highest priority on learning by means of investigative, 
self-chosen experiences with real materials and phenomena-- 
both for the adult college student and for the elementary 
student; conception of the teacher as a continuing learner; 
philosophy and methods associated with the British "open" 
primary schools. 

° Academic policymaking by joint faculty-student -community 
governing board. 

Tofget market: "Less-than-degree" classroom teachers in North Dakota 
schools; fully certificated North Dakota teachers pursuing a master's 
degree; and citizens of North Dakota. Inasmuch as the New School was 
created as a result of a statewide Legislative study and had as its 
long-range aim the upgrading of instruction in the state's elementary 
schools, both the innovative teacher education program and the new 
style of classroom teaching which the New School projected would have 
to satisfy North Dakota citizens. Most specifically, that meant 
pleasing parents of students whose teachers were enrolled in New School, 
as well as school boards and administrators. 
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Co&ii For the retraining of an underqwllfled teacher a school district 
contributed 90 percent of the teacher's salary for a period of one or 
two years (the time the teacher needed to complete the B.A.)i enabling 
the teacher to attend the New School as a full-time resident student. 

i These contributions over the New School 's four years totalled about 
1.2 minion.) To start the program in 1968 a "package" -funding of 
600»000 was received from the Office of Education's tPDA, Bureau of 
Higher Education, and ESEA. In 1969-73 EPOA's Trainers of Teacher 
Trainers program provided a total of $1 ,'/60,000. 

Outoom&a and evalmtioni 

1- Degrees granted . B.A. degrees to 240 less-than-degree teachers 
from North Dakota Schools. The percentage of less-than-degree 
teachers In the state dropped from 59 percent in 1967 to less 
than 20 percent in 1973. M.Ed, degrees to 295 certificated 
teachers completing one-year internships In North Dakota schools. 
(200 remain in North Dakota schools.) T7 doctoral degrees. 
150 B.A.'s to young students who had never taught before. 

2. School districts that cooperated with Ne w School . Seventy-five 
schools in 48 school districts (out of 3o3 in the state) worked 
directly with New School for at least a year. These districts 
enrolled 52,000 of the approximately 115,000 K-8 pupils in the 
state.) 

3. Extent of diffusion of open classroom practice . 

a. The existence and pers1s»;ence of a significant degree of open 
practice in the classrooms of New School graduates, and the 
gradual spread of sorte of those practices to other teachers in 
the same schools, is attested by several research studies by 
New School faculty and doctoral students. 

b. A number of New School graduates have emerged as leaders in 
their school districts and in state educational associations. 

c. Doctor's degree graduates have taken positions as professors 
In state colleges; doctor's and master's graduates have become 
administrators In a number of school districts. 

d. The New School's federally-funded Follow Through program, 
started in 1970 at the Initiation of several school districts 
impressed with New School ideas, carries out all the educational 
principles and methods developed by the New School faculty 
since 1968. 

4. Parents' acceptance of open educati on. A 1972 study of 276 parents 
whose children were enrolled ln New iichool interns' classrooms 
showed 76 percent were 'very favorable' or 'somewhat favorable' to 
the classrooms. 
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5. Influence on th6_Un1vei^s1ty . The New School pattern for teacher 
preparation and for an acadenilc policy council (involving students, 
school administrators, and parents as voting tnembers) Is continuing 
In the University's reorganized school of education, the Center for 
Teaching and Learning. 

Current dtatuet In July, 1972 the New School was merged With the Univer- 
sity's College of Education (and School of Librarlanship), creating the 
Center for Teaching and Learning with New School director, Dri Vlto 
Perrone, as dean. The Center preserves the pattern of teacher education 
developed by the New School. A new three-year staff development program 
funded by the National Institute of Education In July, 1973 Is directed 
toward New School graduates at work In North Dakota schools. 

lnn<?vaHve effeotei New School was designed tO Introduce teaching practices 
similar to those of the "open" British Infant schools into North Dakota 
elementary schools. Changes In school district budgetary allocations 
were unnecessary since Interns were supported through a federal grant. 

Sympeie of diffusion: Like developers described In other case studies, 
organizers of the New School attempted to change traditional Instruc- 
tional practices. Rather than developing a product, they chose to 
Institute a new form of teacher education. Becfliuse this program did 
not Involve a product and since It was not a prototype, tn6re was no 
long period of development and field testing. Development of dissemina- 
tion strategies was combined with development of the program itself. ' 

Those practicing teachers In North Dakota who had less than a Bachelor's 
degree were encouraged to complete their B. A. 's In the New School while 
master's degree candidates replaced them In the classroom. The teacher 
Interns, trained during the summer, carried New School philosophy and 
practices directly Into the schools and communities in North Dakota while 
less-than-degree teachers were receiving a firm foundation In the new 
teaching methods. ' 

Dissemination and Implementation of the program were assisted by field 
aaents. Six to eight full time faculty members and doctoral students 
visited interns in their schools, brought new materials and methods 
from campus, gave moral support, and helped them share ideas with each 
other through seminars. The field staff also served as a liaison 
between the teachers, administrators, and community. Parents learned 
of the program in advance through meetings faculty held all over the 
state, and during the school year through meetings with interns. 
Further support was gathered through a public Information program. 

The New School, during its short four-year existence, was successful In 
spreading new teaching methods in North Dakota; it contributed to reduc- 
tion of less-than-B.A. elementary teachers from nearly 60 percent in 
1968 to less than 20 percent in 1973. The school was also successful 
In establishing better communication among the statewide and local 
educational agencies in North Dakota. Research studies indicate that 
the New School graduates continue to practice the methods learned at 
New School . 
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THE PROGRAM 

An ad hoc teacher preparation program was established at the Univer- 
sity of Nortn Jakota in 1968 to provide an appropriate undergraduate pro- 
gram for experienced North Dakota teachers who were teaching with certlfl-- 
cates Granted after JuSt two years of college and who now wanted to (or 
were willing to) complete their B.A. degrees. The upgrading of these 
teachers was one part of a plan to Improve the state's elementary schools. 
The other part was to introduce to fully qualified teachers some new 
teaching techniques which could modernize instruction for children who 
needed to be prepared for futures that probably would be markedly different 
from the lives of their parents in North Dakota towns and farms. 

The program was designed as a short-term effort but one that would 
provide a full-time residence at the university for. the underqualified 
teachers and an in-depth experience in innovation for the certificated 
teachers seeking advancement. Thus the New School adopted the mechanism 
of having the master's candidates do full -year Internships in the class- 
rooms of the baccalaureate candidates' home classrooms. The approach to 
modernization and individualization which the interns were to introduce 
was that of the "open classrooms" in the British infant (primary) schools. 
This approach recommended itself to New School designers because it cap- 
italizes on the strengths and allows for the individuality of experienced 
teachers, and it uses as learning resources the natural and man-made 
environment of whatever community a school serves. It requires no invest- 
ment in complex equipment or new textbook series. 

Open education does, however* require a drastic change in the rela- 
tionship between the teacher and student. The student learns from his 
active, concentrated, increasingly self-directed Involvement with materials 
and experiences. The teacher organizes and individualizes the materials 
and continually explains and discusses the concepts and skills which derive 
from the student's work. 

The New School academic program adhered to the learning principles 
which underlie the elementary open classroom. The teachers returning to 
the role of student were confronted by a university experience demanding 
a degree of self-direction and resourcefulness unfamiliar and even 
threatening to many of them; by a faculty, representing all the liberal 
arts disciplines plus education, who resolutely avoided making decisions 
for students; and by a student body diverse in terms of age, experience, 
and commitment to open education. 

It appears that the New School in only four years managed to generate, 
plant, and nurture a new,' North Dakota strain of Individualized, activity- 
based, natural -materials-oriented educational practice in scores of schools 
In every part of the state. Today, the New School ideas vary in applica- 
tion from struggling to thriving, from superficial to profound, but they 
do persist, and they are spreading to other teachers wno have not been 
participants in the New School. The influence of the New School is felt 
far beyond North Dakota among American educators interested in open educa- 
tion. Finally, New School's mfithods of teacher education and patterns of 




educational pcMcyinakIng have been Incorporated In the University of 
North Dakota's reorganized Interdisciplinary college of education, the 
Center for Teaching and Learning. 

Unlike other case studies In this book which deal with educational 
products, this study describes a program of teacher education as an Instru- 
ment of change. The following pages describe the New School In terms of 
Its objectives for change, program design, participation ("adoption") 
by school districts within North Dakota, and the changes ("Implementa- 
tion") In classroom practices which came about. 



DEVELOPMENT 

The North Dakota Legislature, University, Department of Public In- 
struction, and a number of school districts conducted a statewide study 
of public education between 1965 and 1967. At the finish the study di- 
rector characterized public elementjiry schools as "ineffective, ineffi- 
cient, and Inequitable." A major deficiency was the underpreparation of 
the state's elementary school teachers. North Dakota ranked fiftieth 
among the states; only 41 percent of the 4,537 elementary teachers 
held a college degree. The average age of the underprepared teachers was 
43, and as a group they inspired little confidence that they would ever 
complete their bachelors' degrees under their own steam. North Dakota 
also ranked fiftieth in overall opportunities for elementary schoollngi 
there were few kindergartens, few remedial teachers or specialty teachers, 
Rural schools were the least adequate on the above counts and also on 
the criterion of student standardized test scores. The stu4y concluded 
that more money— local, state, or federal --would be wasted "unless and 
until the State embraces and vigorously pursues reasonable plans of 
local district reorganization and personnel development." Moreover, 
the study concluded "that it was not enough merely to certify teachers. 
The goal was better education through teachers trained and supported for 
classroom innovation."! 

The study concl udod that existing teacher education programs could 
not accomplish the majfsr retraining necessary for full teacher certifica- 
tion and innovation. Nor could the existing educational establishment 
create the new relationships which seemed essential aniong school districts, 
sUte department of education, and higher education. Thus the study 
called for the University to develop "a new ad hoc school of behavioral 



Statewide Stu<iy of Education, Educational Development for North Dakota; 
1967-1975 . Grand Forks, N.D., 1967. Overview, p. 6-Zl. 
(Six volumes of the study are available from the office of the State 
Superintendent of Public Instruction, State Capitol, Bismarck, N.D.) 
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sciences." It v/as to work toward tne goals of placing a fully qualified 
and certified teacher 1n every classroom in the state by 1975 and of estab- 
lishing cooperation among the state teacher education programs, the state 
department of public instructloni and the local school districts. 

At the point when the North Dakota task force was making its recom- 
mendations, some members came across Joseph Feathorstone's New Republic 
articles about a new style of education in some of England's primary or 
"infant" schools. North Oakotans saw the similarity between their local 
challenge and that of the English who had developed the "open classrooms" 
described by Featherstone. The North Dakota planners wanted to provide 
individualized, flexible, interdisciplinary learning experiences fitting 
children to cope self-reliantly with extensive but unpredictable changes 
during their lifetimes. The innovation they recommended could not re- 
quire districts' large investments in new buildings, specialized staffina, 
and modern educational technology, all of which seemed feasible only with 
very large school populations. The English informal primary schools 
seemed in fact very similar in physical attributes and staff resources 
to the small town and rural schools still familiar across North Dakota. 
The difference was the teacher-student interaction in the English schools, 
which gave both student and teacher greater responsibilities and choices 
for learning. The commitment to upgrade teachers' professional capa- 
bilities was matched by a determination to increase local communities* 
participation in educational policy making, local and statewide, These 
purposes were consonant with the guidelines of the federal Trainers of 
Teacher Trainers (TTT) program, wnich funded the new teacher education 
program. (A portion of the first $600,000 grant came from ESEA. There- 
after $1,360,000 came from TTT between 1969 and 1972.) 

Another principle of TTT was that teacher education faculties must 
be in close touch with other departments of the university, especially 
liberal arts faculties. Thus when the New School of Behavioral Studies 
in Education was founded at the University of North Dakota early in 1968, 
the faculty represented a cross-section of the University. "Liberal 
arts faculty who before were never consciously involved in the prepara- 
tion of teachers joined professional teacher educators in a single, 
unified faculty with no departments isolating them from each other, no 
divergent purposes dividing them. "2 

The New School's first session began in June, 1968 when the first 
group of 55 master's degree candidates arrived at the Grand Forks campus 
for an 8-week summer session that prepared them for 9-month teaching intern- 
ships in North Dakota schools starting that September. 



^Center for Teaching and Learning, University of North Dakota, The ilew 
School : A Review , Grand Forks, 1972. p. 14. 
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All fully certified, these interns would, for the 
most part, replace less-than-degree teachers who 
would be returning to the University to complete 
their baccalaureate degrees In the fall. This ex- 
change of personnel remained the backbone of the 
New School's involvement with North Dakota communi- 
ties.... The school districts would release those 
less-than-degree teachers volunteering to return to 
college and would, in turn, accept the master's de- 
gree interns In their place. The districts also 
would send the Hew School about 90 percent of the 
less-than-degree teacher's original salary. This 
money, plus some from USOE, was used to pay both 
returning teachers and Interns' stipends worth 
$3,000 to $5,000.3 

The interchange between the less-than-degree teachers and the master's 
degree interns was not the entire New School program. There were also 
undergraduate students at the junior and senior level, who participated 
In courses along with the experienced returning teachers. And there^was 
a small doctoral program to prepare teacher educators for positions in 
the state colleges and local school districts. Dr. Vlto Perrorte, an his- 
torian from Northern Michigan University, headed the New School. 

"The more responsive, open classroom" which the interns were to de- 
velop was inspired by the British informal classrooms. However, the New 
School did not mandate a specific model of physical organization, grouping 
of students, or curriculum content. New School held up the following 
characteristics of a classroom as desirable: 

1. An atmosphere of mutual trust and respect among teacher(s) 
and children. 

2. The teacher acts as a guide, advisor, observer, provlsioner, and 
catalyst, constantly seeking ways to extend children in their 
learning. The teacher views himself as an active learner and 
typically works without a pre-determined, set curriculum. 

3. A wide assortment of materials for children to manipulate, con- 
struct, explore, etc., is available in the classroom, thus pro- 
viding rich opportunities to learn from experience. Materials 
will have diversity and range with very little replication. 



^Ibid., p. 4. 
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4. Learning through play, games, simulations, and other activities 
engaged In for their own sake are legitimized.... 

5. Activities arise often from the Interests children bring with 
them to school. 

6. Children are able to pursue an Interest deeply In a setting 
where there Is often a variety of activities going on simul- 
taneously. 

7. There are few barriers between subject matter areas and a mini- 
mum of restrictions determined by the clock, thus providing a 
fluid schedule that permits more natural beginning and ending 
points for a child's learning activities. • 

8. Children's learnlna Is frequently a cooperative enterprise 
marked by ch11dren''^s conversation with each other. 

0. Older children frequently assist younger children in their 
learning. 

10. Parents participate at a high level in the classroom, sharing 
1n children's learning. They also assist children outside the 
classroom where much of the children's learning takes place. 

11. Emphasis is on communication, including the expressive and 
creative arts.^ 

However, each, teacher was to Implement these ideas in ways that suited the 
needs and Interests of students, the resources of the school setting, and 
his personal educational beliefs, capabilities, and style. It was assumed 
that many conditions and forces in the schools where New School people 
taught would strongly Influence a teacher's "opening up." 

In practice, the first actions taken to Infuse New School ideas into 
a classroom usually Involved some rearrangement and additions so that 
students were not confined to desks, blackboard, and texts. For at least 
part of the day students could move around and talk freely. Perhaps they 
would pursue science investigations with homemade apparatus, plants, 
and animals. Or they might work with manipulative math materials and 
eyeryd&y uses for math (classroom store, cooking, measuring, graphing 
tasks, etc.). Beginning reading Instruction was based In children's own 



^Perrone, V., and Pederson, C. A., "A Sea of Activity," Insights 5 (7). 
April, 1973. p. 9. (The newsletter of the Center for Teaching and 
Learning, University of North Dakota) 
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spoken language, which was stimulated by singing, by painting and talk- 
ing about paintings, by storytelling, and story-acting-out. Children 
were encouraged to write their own stor1e$, But basal readers, phonics 
drill, workbooks, audiovisual equipment, and other tried-and-true tech- 
niques could also be part of the blend. 

The New School placed great emphasis In the teacher designing his/her 
own classroom environment and creating as many curriculum materials as 
possible, not relying totally on books and workbooks. Contributing to 
the Innovating teacher's creative energy "crunch" were the requirements 
that materials ought to be taken from, or relate to, the surrounding 
natural and sociological environment of the school; and they ought to 
move each child to measurable skills and concept learning. 

If the teachers whom the master's degree Interns were replacing In 
North Dakota classrooms were to carry on this kinrf of program when they 
returned to their home schools, they would have U experience an unusual 
kind of college learning during their residence at the Grand Forks campus. 
The approximately 50 less-than-degree teachers who enrolled In 1968 In 
the New School—mainly middle-aged and mainly women— Joined an equal 
number of young undergraduates without teaching experience. The student 
body which resulted was characterized by one observer as "a fascinating 
heterogeneity of ages (from 18 to 60) and values rare In an American com- 
munity of any kind in this era of widening gaps. "5 They encountered a 
striking heterogeneity of educational experiences highlighted by constant 
change, and what Vlto Perrone called "de-learn1ng of their former de- 
pendency." 

The faculty felt quite strongly that teachers ultimately 
teach In the same manner In which they have been taught 
and that If students are to be trained for open class- 
rooms they first must experience as students the kinds 
of qualities open classrooms have. Consequently, stu- 
dents were given much freedom In planning and carrying 
out their own programs. Responsibility for learning rested 
on themselves. ° 

There were no course requirements, no assigned textbooks, 
no large-group lectures, no letter grades. Each semester 
students enrolled in three or four ^umbrella' courses 
(conwunl cations, human relations, creative expression, 
science and math). Under these courses, which carried 
four semester credits each, the students undertook programs 



^Resnick, H. S.. "Promise of Change In North Dakota." Saturday Review , 
April 17, 1971. p. 69. 

^A Review, op. cit. , p. 5. 
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which Included scheduled activities, as well as un- 
scheduled ones, seminars, Independent study, tutorials, 
and various experiences out In schools. At the core 
of their programs 'was their Involvement with a faculty 
advisor.... The advisor-advisee relationship was a 
close one Intended to be the vehicle through which the 
student could truly Individualize and personalize his 
program. Each student Joined his advisor In evaluating 
the quality of his work and his progress.' 

There were no faculty departments or divisions at New School. 

An organizational chart would show a dean, a program coor- 
dinator, faculty, and students. Decision making at first 
took place through a "Committee of the Whole" involving 
all faculty and students. In an effort to broaden the 
decision-making apparatus, a new body was created and 
implemented during the 1971-72 school year. This com- 
mittee, or "monthly Meeting" as it was called, consisted 
elected representatives of faculty, students, alumni, 
parents, school administrators, Indians, and personnel of 
the State Department of Public Instruction.... The 44- 
member group met once a month on the campus to make policy 
and operational decisions regarding the New School. The 
dean, who also sat with the group, was essentially respon- 
sible to its decisions.... 

The chief reason for establishing such a decision-making 
body was to bring together representatives of the various 
parties having a stake in education. . .to operate a program 
in conjunction with, rather than In isolation of, the com- 
munities it Intended to serve.... 8 

...DIFFUSION . , 

The New School's dissemination strategy was entwined with the develop-, 
ment of the college program, because both less-tiian-degree classroom 
teachers and certificated teachers seeking master's degrees through Intern 
ship had to be recruited in ordpr to begin the program. Since they were 
employees of school districts, recruitment meant persuading administrators 
and school boards to join the New School program, sight unseen. Several 



Review , op. cit., p. 5, 6. 



^Ibld.,' p. 7, 8. 
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other aspects of the situation ware equally difficult: 1. The exchange 
of classrooms between less-than-degree teachers and master's interns 
meant that local administrators' and parents' experience of New School 
ideas in action could not be gradual—after a decent period of inservice . 
training by a district's own staff— but was immediate, and was carried 
out by Interns who were strangers in the community. 2. The scope and 
duration of the ad hoc New School were extremely limited compared to the 
complexity of the innovation: givina children choices about their school - 
work, subordinating the mandated textbooks series to teacher-created 
curriculum encouraging talk and movement and play'-like activities. 3. In 
the face of that challenge to traditional attitudes, the New School 
needed to Implement Us new practices without the backing of pilot testing. 
It had no local prototype to follow, no field test results to learn 
from. 

However, the New School never saw its mission as straight, one-way 
diffusion—from Grand Forks to local school districts. Its conception 
of diffusion was that In a two-way commurti cations process "North Dakota 
schools will be examining and evaluating their instructional programs to 
see if they are entirely relevant to the educational needs of the State 
(while) the New School is assisting. . .by demonstrating alternative ap- 
proaches. . .."9 

The result of the teacher exchange program is that... 
the New School accepts increased responsibility for 
the quality of instruction in those classrooms staffed 
by New School resident interns (and) the cooperating 
school districts become a more active participant In 
the teacher preparation process. Thus, each shares more 
in the responslbnities which have traditionally belonged 
to the other. 10 

The several communications efforts undertaken to interpret the New 
School also were experiencvs- and information-gathering efforts helping 
to shape the program. These included relations with school administra- 
tors, field supports for Interns in their classrooms, communications 
with and involvement of parents. 

/ ' 

Relations with Schools 

Informational meetings were held throughout North Dakota in winter 
and spring 1968 in order to recruit both less-than-degree teachers and 
masters Interns. In some communities teachers went to their superintendents 



%w School for Behavioral Studies in Education, A_Descr1pt1on of the New 
School. Prepared for 1969 annual meeting of The American Association 
of Colleges for Teacher Education, p. 2. 



^°Ibid.„ p. 4. 
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or school boards and asked for support to join the program. In others, 
administrators went to teachers and encouraged them to enroll. From the 
start, New School had a policy of not recruiting from school districts 
that would send only one less-than-degree teacher or Intern. U was 
thought that a single New School teacher In a district would be too Iso- 
lated to be able to persevere in Innovative practices or to Influence 
teacher colleagues. 

Between 1968 and 1972 the New School sent Interris Into every city- 
sized district In the state and into town and rural districts In every 
sector of North Dakota. Roman Catholic and Indian reservation schools 
also participated. In the first year, 13 school districts joined the New 
School program; In 1970-71, the peak year, 34 districts were involved; 
and by the end of the program 48 districts (75 separate schools) had par- 
ticipated. The less-than-degree teachers tended to come from smaller 
communities, master's degree interns from larger. Most districts par- 
ticipated at least two years, the time needed for their less-than-degree 
teachers to complete their B.A.'s. Two-thirds of the total number of less- 
than-degree New School students entered the program In the first two years. 
The faculty believe this was because the teachers who were the most ven- 
turesome--1n terms of desire for innovation, professional advancement, 
and ability to leave home and live in Grand Forks for two years--were 
reached at the start. Those less-than-degree teachers who already had 
completed substantial credits beyond their two-year degree were not 
recruited as full-time resident New School students. They were encouraged 
to finish their B.A.'s in summer sessions at the New School, the college 
of education, or one of the four state colleges. A link with these other 
institutions of higher education was thus formed. The New School assisted 
one of the state colleges--Mayv111e--to develop a non-resident program 
for such teachers, and this program served 57 less-than-degree teachers in 
1973. 

The New School held summer workshops on campus each year for principals 
in whose school interns would be working. The first workshops were well 
attended but later few administrators came to Grand Forks to prepare for 
interns' implementation of the program. One faculty member speculates 
that this was because in later years administrators believed they had 
enough information. Actually, many principals had gained only superficial 
understanding of the chanhes in teaching-learning interactions needed in 
an open classroom. In mcJny cases the principal's knowledge about New 
School proved to be insuflficient to enable him to help the interns work 
out their new teaching methods, work with other staff in the school, arid 
interpret the program toj parents. The strongest influence with administra- 
tors was not the campus workshops but the on-site visits of the New 
School's field support staff. 
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Field Support Agents 



the master' s-candidate Interns served as the first bearers of the 
open classroom innovation In North Dakota communities. There were 55 
Interns during New School's first year; 103 the next; 80 In 1970-71; and 
about 50 In 1971-72. New School set up a field support system to assist 
the interns in innovation. One form of support consisted of four clinic 
professors, each serving a different area of the state, whose assignment 
was to take Interns new materials and methods from campus, give them moral 
support, and help them share ideas with each other by means of seminars. 
Equally Important, the clinic professors served as ombudsmen for Interns 
in dealing with their school administrators and as public relations 
men, Interpreting the New School program to parents and community organi- 
zations. The other form of support was a corps of four resource col- 
leagues, also serving statewide. These were doctoral students, who were 
available to help in an intern's classroom, to work with children, observe 
problen^s, bring new materials, scout for resources for learning in the 
community. Interns received onsite visits from one or another or both 
of these support agents about once a month. The intern's faculty advisor 
also visited at the start of the internship and from time to time to re- 
assure or advlsA about problems. 

Faculty also held after-school or Saturday curriculum workshops for 
interns and other teachers in their schools or districts. New methods in 
elementary science, math, creative drama, language arts, and reading were 
presented around the state. Parents also were Invited to attend 
these workshops. 

The New School's monthly newsletter, Insights, carried new curriculum 
and methods ideas from campus to Interns and graduates, and provided a 
medium for them to share their own new discoveries with each other. 

Outreach to Parents 

Parents were the major target of a statewide dissemination campaiijn 
by New School faculty. During the four years approximately one hundred 
parents' meetings were held throughout North. Dakota. Vitb Perrone criss- 
crossed the state, speaking to more than ten thousand parents in the first 
year alone. He and other faculty members were committed to listen as 
well as talk to parents so that they could interpret the New School ideas 
in the context of parents' concerns for their own children. As one faculty 
member put it: "Every parent has Inside of himself vital, alive, fresh 
ideas of what he wants for his kids." 
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Hot Just Information but participation by parents was a goal of the 
New School. New School faculty went anywhere In the state to partici- 
pate In discussions with parents about educational issues, even to hold 
curriculum workshops so that parents could experience the difference be- 
tween activity Involvlna concrete materials and use of texts or workbooks. 
The policymaking council of the college included parents as regular Vot- 
ing members. Many Interns recruited parents to work In their classrooms. 
New School faculty considered this Involvement to be the most effective 
means of parent communication., 

Public Information program 

. The New School conducted a public information effort to state news- 
papers, other educational institutions in and out of the state, parent 
and community groups. This work coincided with Charles Silberman's 
Carnegie-supported survey of elementary education. Silberman's testimony 
on April 19, 1970, before the U. S. Senate Select Committee on Educa- 
tional Opportunity, and his book, Crisis in the Classroom (Ramdom House, 
1970), praised the New School as one the* few oases of hope for elementary 
education In the nation. It was a natural news story: North Dakota hin- 
terlands seen as avante-garde of education! Silberman's enthusiastic 
description excerpted In the June and July, 1970 Issues of Atlantic 
was followed by articles that year in The New York Times . The Wall Street 
J ournal . Reader's Digest . Time . The Saturday Review , and by 1972 color 
documentaries on CBS-TV and PBS. These weria not rewrites of New School 
press releases but original, in-the-fleld coverage by education writers 
of these media. 

The early articles became a major Influence on the New School because 
they attracted students like pilgrims from all over the nation. Many 
of the out-of-state master's degree candidates were more knowledgeable 
and conwitted to concepts of open education than were the North Dakota In- 
terns, less-than-degree teachers in thfj undergraduate program, or North 
Dakota c1t1zens--the audience for whom the New School program was designed. 
Some of the out-of-state undergraduate students had little or no experience 
with children or commitment to teaching, but simply came for the "free" 
undergraduate curriculum of the Vew School. Beginning in the school year 
of 1970-71, about 50 percent of the New School enrollment, both under- 
graduate and. graduate, came tYom out of state. The New School's cempus- 
community Interchange meant that these out-of-stat6 students influenced 
not only th^ college program but the community implementation of open 
( lucation. I 

Professional visitors from all parts of the nation and all continents 
also came to Grand Forks—lS to 20 a week, as many as 1 ,000 a year. Their 
cause and effect were summed up by Warren Strandberg, New School program 
coordinator, quoted In an article in The Wall Street Journal on December 1, 
1970./ " 



Most efforts to change the behavior of teachers have 
failed utterly. So people are coming from everywhere 
to see great and wonderful things and worship at the 
font of change. But this is no Mecca. We're Just 
some very average people trying to do some very dif- 
ficult things, 



OUTCOMES 

Student and School District Participation in New School 

Less-than-degree teachers earning Baccalaureate 
degrees by summer 1972: 

Total number of Baccalaureate degrees conferred 
by summer 1972: 

Baccalaureate degrees In process in summer 1972: 

Master of education degrees earned after school- 
year Internship: 

Master's degrees In process: 

Doctoral degrees conferred: 

Doctoral degrees in process: 



The New School was a leading participant In the statewide campaign to 
persuade less-than-degree teachers to finish their B.A.'s— if not In resi- 
dence at the New School then perhaps at a state college or during summer 
sessions. This effort resulted in a reduction of the percentage of less- 
than-degree elementary teachers in the state from 59 percent in 1968 to 
20 percent in 1973. The goal of the statewide study had been to place a 
fully qualified teacher in every classroom in the state by 1975. By 1973 
the overall percentage (both elementary and secondary) of less-than- 
degree teachers had been reduced to 13 percent. 

Out of the 303 public and parochial school districts in the state, 53 
participated in less-than-degree and master's internship placements through 
the end of the 1973 school year. In these districts 80 separate schools 
were involved with New School j the! districts enrolled roughly half of 
the state's elementary school population. j 
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Educational Coinmunj cation 

There are several Indications that the New School was successful In 
establishing clearer*, more reciprocal communications among the teacher 
preparation institutions and local educational agencies in the state. 
The effort to reach and to educate the less-than-degree teachers was In 
Itself a communications link between the New School and the four North 
Dakota teachers colleges. 

Although exact statistics are unavailable, the New School doctor's 
graduates and some of the master's graduates have taken positions in 
state colleges, in the state education department, and in school districts, 
where they continue to be links with the University. New School graduates 
are emerging as leaders among teachers, as indicated by the high propor- 
tion of New School graduates presenting curriculum workshops at confer- 
ences of the North Dakota Education Association and the Classroom Teachers 
Association. 

A new communications link between the teacher preparation institu- 
tion and the local school district was formed by the New School Interns 
And the field support agents. Messages not only went out to the schools, 
they came back from the schools, and parents were welcomed Into the 
dialogue. Now that the internships and field support services have been 
sharply cut back this link may weaken. 

The university-community communications link was also affected by 
national communications about the New School, Wide acclaim resulted in 
enrollment of scores of non-North Dakotans wanting to learn how to imple- 
ment open classrooms. Many held personal and educational values which 
differed from those prevalent in conservative communities. In such cases» 
communications about the open classrooms were distorted by the static of 
parents' disapproval of Interns as people. 

The opportunity for continuing statewide communicatior; about education 
exists in the governing council of the newly constituted Center for 
Teaching and Learning, the University's college of education. This council 
is active, meeting monthly, and Its voting membership includes representa- 
tives from the Department of Public Instruction, public and nonpublic 
administrators and teachers, high school students, and American Indians, 
as well as graduate and undergraduate students and faculty of the Center. 

Influence on the Unl varsity 



The basic princibles of the New School are central to the Center for 
Teaching and Learning, the University's new interdisciplinary college of 
education, which in July 1972 merged the New School with the regular 
college of education and the school of librarianship. Perrone is the dean 
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of the Center. Because 1t Incorporates secondary and educational adminis- 
tration programs and educational research, CTL provides a potential scope 
of influence wider than the New School's. But the merger also necessitates 
blending New School concerns with those of more conventional faculty. 
Nevertheless, 18 months after its founding the Center demonstrates many 
of the characteristics of the New School: an interdisciplinary faculty 
(Despite loss of some New School faculty who were supported by TTT, there 
is still a high level of liberal arts participation); informal faculty/ 
student relationships j the opportunity for great flexibility in course 
planning and student evaluation; the option for preparation in open 
classroom teaching; the master's degree internship program (though at a 
greatly reduced level; and the means of governance involving not ji'.st 
faculty but students, district administrators, teachers, and parents. The 
Center enrolls about 1,400 students. It was accredited by NCATE in March 
1973. 

It is an open question whether the unique New School spirit and 
processes will last without the protection which the New School's small- 
ness and experimental status afforded. One graduate student, assessing 
the Center in 1973, observed that the New School approach probably will 
gradually peter out because the University will not "be excited enough 
about it to recruit interesting faculty," and accept and encourage "open, 
radical, curious, young students." A New School faculty member who 
spent one year in the Center before moving to another state said the 
Center seemed "much more structured and like a traditional program" than 
the New School had been. There was still a chance to create flexible, 
individualistic student programs but It took a strong intention, per- 
sistence, and "finagling." But after a year away "it still seems like 
the most radical program 1n existence." A New School faculty member still 
on the Center staff says that the necessity for the Center to go through 
regular University channels for routine matters of registration, creation 
of courses, grading, credits, and the like, causes a brake on continuing 
innovatlveness. Perrone believes that understaffing, not channels, is 
the root problem. 

In assessing the New Schoors impact in the newly formed Center, in 
the University, and in teacher education at large, Perrone says, "Within 
the Center we nov have a lot of people who come from a different frame 
of reference, but I think they are finding that a lot of problems they 
feared aren't developing, that New School faculty are more reasonable 
and students more responsible than they had believed." 

The program has attracted large numbers of students 
who would not otherwise be involved in teacher educa- 
tion. They have come to education from a variety of 
other academic and professional backgrounds and have 
demonstrated their capacity to enrich the intellectual 
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life of schools. Nationally, fewer than four 
percent of those preparing for teaching ?it the 
elementary school level are men, The percentage 
In the New School ranged from twenty to forty 
percent,... Programs and courses which relate 
to Native American Issues have been organized.... 
The University made a formal commitment to North 
Dakota Indian communities. Grading practices 
within the University are undergoing significant 
reexamination and change.... There Is an en- 
larged Interest In teacher education among liberal 
arts faculty--not Just at the University of North 
Dakota but In many other Institutions.... H 



Follow Through Program 

In 1970 the New School was selected to conduct a Follow Through pro- 
gram of open education by the school districts at Fort Yates, North Dakota, 
Zuni, New Mexico (both Indian reservations). Great Falls, Montana, and the 
three communities north of Seattle, Wash1ngton--Burl1ngton-Ed1son, 
Ferndale. and Sedro Wooley. New School (now Center for Teaching and 
Learning) faculty provide on-campus and Inservlce training for the Follow 
Through teachers and aides In 81 classrooms, onslte advisory service, and 
Instructional materials. 

Future Indian Teachers 

The New School Initiated a Career Opportunities Program In teaching 
for men and women from four North Dakota Indian reservations. During 
1973-74, fifty-six are enrolled. In May 1973, thirteen FIT students re- 
ceived B. A. degrees and remain In teaching In their communities. In May 
1974, 27 more will earn degrees. (When this program began In 1968 there 
were two Native American teachers In North Dakota.) 

Both Follow Through and the FIT programs overlapped with the regular 
New School (and now the Center) teacher preparation programs so that stu- 
dents In all programs work with each other and the same faculty are avai- 
lable to all . 

Degree of Openness In New School Classrooms 

In February 1972 the New School faculty and students conducted an 
evaluation based on Indepth Interviews with New School Interns then teach- 
Irig In 24 North Dakota public school classrooms; with theljr pupils (12 
pupils from/each classroom); and. with the mothers of those pupils. The 



'^Perrone, V., A Summary Statement Presented to the National Advisory 
Council o n Education Professions. May, 1973. p. 9-10. 
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study sought to discover the extent of application of open practices In 
the Interns' classroom and to assess the extent of parents' understanding 
and approval of the new classroom style. 

The evaluation assessed teachers' practice of openness along seven 
dimensions: peer Interaction among students i diversification of learning 
materials and activities ■.Tnf'n malltv of relatt6hsh1ps between students and 
teacher} Individualization o f lessons according to learning level, Interests, 
and gtyle; decehtral Uatjon of declslon-maklna (teacher—and students both 
contributing to choices about school work); Integration of subject matter; 
and u se of the comma ill ty as a resource for learning. 0"n the first three 
dimensions evaluators Judged that the Interns as a group—after six months 
work to develop their open class rooms --were operating In the upper, or more 
open, ranges of the dimensions. On the dimension of individualization , 
about half were In the lower range and half In the uppers On the last 
three dimensions, evaluators Judged "that thase classrooms were somewhat 
more centralized, less Integr'ated, and less community resource oriented 
than appears desirable. ... "i2 

Although the 1972 Interns were a long wav from the New School's Ideals 
of what an open classroom should be, the Interns were far ahead of other 
North Dakota teachers along the dimensions of open practices. This was 
confirmed by an extensive questionnaire about classroom practlceis which was 
mailed In 1972 to three groups of respondents; one hundred New School 
graduates, one hundred In schools where there were New School Interns, and 
one hundred who had had no New School contact. According to Vlto Perrone, 
this survey showed sharp differentiation In conception of how children 
learn, In Ideas of what will foster learning, and In descriptions of their 
own classroom practice. The New School g.'^aduates were signlflcatnly more 
open, and the teachers who had some contact with Interns were more open 
than those who had none. 

Persistence of Openness among New School Graduates 

Because of the Influence of principals, other teachers, and parents 
upon the New School graduates, and the relative frailty of the New School 
support system, It Is pertinent to wonder whether graduates "retrench" In 
their practice of openness after their Internship year. i 
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One answer to this question Is provided by ^ 1973 m\] survey of 277 
of the master's degree interns graduated between 1968 and 1972. Besides 
administering an extensive questionnaire, the Investigator questioned 54 
administrators In the schools where New ScKbol graduates were teaching , 
and she personally observed the classrooms of 12 of the interns. 

The report notes that New School training is still observable in 
graduates' ''attitudes, understanding and use of various teaching skills," 



and they attribute their understand 
of New School. There are no signif 
practice among the four classes of 



ngs and activities to the influence 
cant differences in attitudes or 
nterns. 1968 through 1972, "thus 



indicating the uniformity of the New School Influence" in all the years 
it functioned. Most of the graduates are still teaching in the same dis- 
tricts where they spent their internship or where they worked the first 
year after 1nternship--that is, .in a North Dakota city or town. 

Questionnaire responses and classroom observations showed that New 
School graduates are most "consonant" with New School philosophy in their 
teaching of reading, writing, math, and science. The graduates' classrooms 
were open in terms of diversity and liveliness of materials, and Individuali- 
zation of lessons, children moving around, talking, learning with and from 
each other, and student self-reliance in solving learning problems. The 
areas in which graduates "tended to be less open" included reliance on 
specific texts and workbooks and commercially made qames and materials, 
and not enough use of coumunity resources. -There is more teacher direc- 
tion than the New School tended to support," ...and less responsibility 
given to children to plan their own work. 

The graduates commented that they needed more help in relations with 
other teachers and in relations with parents and that they continued tQ 
need support from New School after the intern year. "It seems clear... that 
a major teacher support system is critical." The investigator's compari- 
son of the graduates' attitudes with those of their administrators showed 
that graduates "might find it difficult to maintain the attitudes and 
practices presently held." 

However, "The permanency or survival of the Graduate Interns in the 
teaching profession is impressive," Ninety percent of the first class of 
Interns Is still teaching. Of the 1970 and 1971 graduates, eighty-five 
perjcent are still teaching; and of the 1972 class, eighty-six percent 
persist. 13 



l%aig, Sister K. , C.S.J. A Follow-up Study of the Master Deg ree Graduates 
(1968-1972) from the New ScHool of Behav1o ral„ Studi6SHn Education , 
'uoctorai Dtssertation, tenter for Teaching and Learning, University of 
North Dakota, August 1973. p 166-173. 
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Influence of New School on less^-TKjin-Degree Teachers 



There are no data about the less-than-degree teacKers* practice after 
they received their B.A/s and returned to thetr Kome schools. Thus it is 
not possible to prove that tha North Dakota Statewide Study was correct 
In believing that; wre education will make experienced teachers more Inno- 
vative. Nor can one say authoritatively whether or not the New SchooVs 
open style of teacher preparation Is the best way for a college program 
to capitalize on teachers^ expertise and at the same time plunge them 
back Into the experience of being learners. It Is true that more than 
half of the less-than-dearee teachers receiving B.A.'s went on for their 
master's degrees--do1ng internships In their home schools. Thus the 
findings cited above about Interns' openness and persistence apply In 
some measure to less-than-degree teachers, too. 

Achievement of Children In New School Classrooms 

Almost all of the school districts In which New School has placed 
teachers administer the Iowa Test of Basic Skills as a standardized measure 
of children's yearly achievement. In this testing everywhere In the state 
New School children are found to do as well or better than those In non- 
New School classrooms In their schools. In addition one study Indicates 
that children In New School classrooms are ahead of their peers In tradi- 
tional classrooms In Initiative In learning, variety of Interests, re- 
sponsibility for their own activities, and decisions in learning, 14 

In the Burlington, Washington, Follow-Through classrooms, where 
children take the Iowa Test of Basic Skills, the "disadvantaged" third 
graders do as well as students in the regular program, according to Dr. 
Ben Edlund, Follow-Throuah director. Another indication of their achieve- 
ment, Edlund believes, is the fact that 90 percent of the Follow-Through 
children's parents consider that the students are making satisfactory 
progress in school . 

Parents' Acceptan ce of New School Classrooms 

The New School's 1972 interviews with 276 mothers whose children were 
enrolled in the interns' classrooms found that 39 percent of them were "very 
favorable," 37 percent "somewhat favorable," 13 percent ''somewhat unfa- 
vorable,^' and 8 percent "very unfavorable," towards the changes they per- 
ceived In their children's classrooms. Forty-two percent of the parents 
reported that they had become more favorable to the classrooms over the 
course of the year (the interviews were done in February), while only 9 
percent liked the classrooms less than they had In the fall. So practical 
Experience with the open classrooms over the time seemed to gain adherents. 



Madison Elementary School Evaluation Reports No. 1 and 2, August 1970 
and 1971. Fargo, North Dakota. 
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The study discovered that the parent's satisfaction with the child's 
progress and happiness In school was the best predictor of parent's ap- 
proval. A high level of information about the classroom and actual in- 
volvement In the classroom also went along with approval. Disapproval 
most frequently had to do with parents^ emphasis on the need for disci- 
pline, hard work, order, and respect for authority. 

The evaluators commented that teachers of open classrooms need con- 
centrated training in helping parents to see how open practices can be 
compatible with conservative values. 

Teachers who can direct the perceptions of parents 
away from a search for "discipline" to an emphasis 
on "self -discipline," away from a concern about 
permissiveness to a concern with independence and 
and learning to handle responsibility, and away 
from the glare of noise and disorder to a focus on 
children actively Involved in what they are doing- 
teachers who can help parents make these jumps... 
are likely to find a high level of parental sup- 
port. . . . 



DISCUSSION 

Analysis of the New School's outcomes in relation to its goals Is 
at best a subjective exercise, for the faculty was never able to control 
the variables of local influences upon its teachers, and its on-campus 
program was purposely nondoctrinaire. This m^ant that each New School 
teacher had a somewhat different set of starting objectives, and there 
were many uncontrolled variables affecting his ability to achieve the 
objectives. 

From the beginning the New School's two over riding goals--to ini- 
tiate two-way communications about education, and to innovate in the 
state's elementary schools— posed a dilemma for many interns. They had to 
respect parents' values for children's education at the same time that 
they tried to demonstrate a different, way for children to I learn. The 
importance of open conwunications--between New School, interns, and com- 
mun1ties--in solving this dilenma was confirmed in all settings in which 
interns practiced. 

Experiences that were rewarding and those that were disappointing 
showed equally clearly that the school administrator was the key to 
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making parents and teachers communicatii gpenly and fruitfully. But 
the New School had not set a priority on selling Its program to admin- 
istrators, preferring to concentrate Its personal resources on direct sup- 
port to student Interns and cultivating parent groups. Without commit- 
ted administrators preparing the way for interns ^ classrooms » parents 
sometimes misunderstood and actively disapproved of the open methods. 
Without administrators catching the flack from disapproving parents > In- 
terns had to depend on supportive parents to keep their program Intact. 
In communities where Interns were perceived by parents to be young non- 
conformists with an alien life style» It was difficult 1f not Impossible 
to find friendly parents. 

Some school districts which joined the New School program In 1968 
subsequently decided not to send more less-that-degree teachers, because 
of dissatisfaction with youngi nonconformist Interns who replaced the 
local teachers. In at least one small town the long-experienced native 
teachers returning with their B.A.'s found their way had been made very 
stony by the young Interns who had taught In their classrooms while they 
were away. But frequently school districts left the program simply 
because there were no more less-than-degree teachers to enroll. There 
are no data to compare the Influence of the New School prooram In dis- 
tricts where there was strong administrative cooperation with those In 
which there was relatively little Involvement of principals. But It 
seems reasonable to accept Perrone's hindsight judgement that faculty 
should have set a higher priority on relationships with administrators, 
and that a larger corps of field support agents was the one vital com- 
ponent that could have strengthened all aspects of the program-- the 
courses on campus, the Interns* practice, the administrators' support for 
Interns, and the parents* acceptance and Involvement. 

Nevertheless, the steps that were taken to Involve parents appear to 
have been rewarded, on the evidence of the 1972 parents' Interviews and 
the continuing persistence of open classrooms all around the state. 
Parents' support still does not amount to a groundsv;ell of North Dakotans' 
support for open education or grassroots-citizen participation In public 
school governance. But goals of that kind should be cast In terms of 
decades not years, In Perrone's view. 

The New School never did have enough money to support a field staff 
adequate to provide intensive, on-site service across the b1g state. 
Now almost nothing remains of the field support system in the Center for 
Teaching and Learning* The loss of TTT funding thus threatens the gains 
already made with parents, Perrone believes. If it were possible to re- 

( arrange budget priorities in the Center, he would reduce student enroll- 
ment and 'devote more resources to work in communities: developing 
parents' groups and providing Center interns and graduates with a con- 

» tinuing field support system. 

The loss of TTT support did hasten institutionalization of elements 
of the New School's experimental teacher education program into the Uni- 
versity • But with seven fewer FTE faculty positions, and the continuing 
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faculty members' efforts drained off Into making the Institutionalization 
wor:, Perrone observes there Is a great reduction In the New School's 
Impetus for change. 

Yet the New School stream within the Center preserves an open edu- 
cation option, and Perrone and his colleagues are still major contributors 
to the open education movement nationwide. ^ \ 

One of the principles of that movement Is that efforts to evaluate 
children's achievement should also serve as means for teachers to reflect 
about their work and to use their experience as the' basis for continuing 
innovation. The ongoing evaluation of the New School's accomplishments 
is designed to contribute to this process. In 1973 the Center for Teach- 
ing and Learning began a project, funded by NIE, which will provide a 
five-year longitudinal study of the 1972 New School Interns. Center eval- 
uators are redesigning the 1972 parents', children's and teachers' Inter- 
view Instruments so that the interview findings can be ferV back immediate- 
ly to teachers and used by them for continuing Innovation in the direc- 
tions set by New School. 

This evaluation seems consonant with the Hew School's original goals 
of teacher development and statewide educational communication. While it 
gathers the most significant data yet about the New School's accort.pl ish- 
ments, It should also continue the statewide dialogue the University 
started with teachers and parents, and It Intends to use that dialogue to 
encourage teachers' self-directed professional growth. 
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